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* * * 

Claims 

1. A speech input interpreter characterized in that in a speech input interpreter which 
interprets input speech and outputs information on applicable vocabulary items, it is equipped 
with 

a means which stores first information pertaining to normal vocabulary items and second 
information which consids the possibility that some of said normal vocabulary items may be 
replaced by prescribed alternative expressions during speech input, 
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a means for speech recognition of the input speech, 

a means which detects the aforementioned alternative expression from the result of the 
aforementioned speech recognition based on the aforementioned second information, and 
a means which runs a query in the aforementioned first information based at least on the 
vocabulary items other than said alternative expression included in the aforementioned input 
speech recognition result when the aforementioned alternative expression is detected from the 
aforementioned recognition result by said means in order to find said applicable vocabulary item. 

2. The speech input interpreter described under Claim 1 characterized in that it is further 
equipped with a means which evaluates the priorities of applicable vocabulary items based at 
least on the phonemic characteristic of the speech corresponding to the aforementioned 
alternative expression when multiple applicable vocabulary items are retrieved. 

3. A speech input interpreter characterized in that in a speech input interpreter which 
interprets input speech and outputs information on applicable vocabulary items, it is equipped 
with 

a vocabulary storage means which stores alternative expressions obtained by replacing some 
prescribed normal vocabulary items as the target of the speech recognition by alternative 
expressions used to replace arbitrary words as one type of vocabulary item, 
a metrical information storage means which stores the notations of and metrical information on 
the aforementioned normal vocabulary items which do not contain the aforementioned alternative 
expressions out of the vocabulary items stored in the aforementioned vocabulary storage means, 
a speech analysis means which carries out speech recognition and metrical analysis of speech 
input through a speech input device in reference to the aforementioned vocabulary storage means, 
and 

a substitution expression verification means which replaces the aforementioned replaced part by 
the aforementioned normal vocabulary item based on the result of the aforementioned speech 
recognition of the aforementioned input speech and the result of the aforementioned metrical 
analysis by the aforementioned speech analysis means in reference to the aforementioned 
metrical information storage means. 

4. A speech input interpreter characterized in that in a speech input interpreter equipped 
with a means which analyzes speech input from a speech input device for speech recognition and 
outputs a speech analysis result including a speech recognition result and a vocabulary storage 
means which stores vocabulary items as the target to be recognized during said speech 
recognition, it is equipped with 

an alternative expression storage means which stores alternative expressions for replacing 
arbitrary expressions, 



an alternative expression detection means which detects the same expressions as the 
aforementioned vocabulary items stored in the aforementioned alternative expression storage 
means according to the input speech information, 

a substitution expression storage means which stores individual words obtained by further 
dividing the vocabulary stored in the aforementioned vocabulary storage means, and 
a processing means which carries out the speech recognition of said non-replaced part of the 
input speech information other than the part where the aforementioned alternative expression is 
detected by the aforementioned alternative expression detection means while using the 
vocabulary items stored in the aforementioned alternative expression storage means as the target 
of the speech recognition and retrieves a vocabulary item appropriate for the replaced expression 
from the vocabulary items stored in the aforementioned substitution expression storage means 
using the result of said speech recognition. 

5. The speech input interpreter described under Claim 4 characterized in that the 
aforementioned processing means 

carries out the aforementioned speech recognition by the unit of a syllable or a phoneme, 
detects a part where one of the aforementioned normal vocabulary items is added and uttered as a 
part of the alternative expression in reference to the result of said recognition by the unit of a 
syllable or a phoneme, and 

selects an expression which matches the aforementioned detection result with the highest priority 
when retrieving the replaced expression from the vocabulary items stored in the aforementioned 
substitution expression storage means. 

6. The speech input interpreter described under Claim 4 characterized in that the 
aforementioned alternative expression detection means carries out metrical analysis of the input 
speech, and 

the aforementioned processing means selects an expression which matches or approximates the 
metrical requirement obtained as a result of the aforementioned analysis with the highest priority 
when retrieving the replaced expression from the vocabulary items stored in the aforementioned 
substitution expression storage means. 

7. A speech input interpretation method characterized in that in a speech input 
interpretation method in which an input speech is interpreted, and information on applicable 
vocabulary items is output, 

speech recognition is carried out with respect to the input speech, 

an alternative expression is detected according to the aforementioned speech recognition result 
based on information pertaining to normal vocabulary items which consider the possibility that 
some of the prescribed normal vocabulary items may be replaced by prescribed alternative 
expressions during speech input, and 



a query is run in the information pertaining to the prescribed normal vocabulary items based at 
least on the vocabulary items other than said alternative expression included in the 
aforementioned input speech recognition result when the aforementioned alternative expression 
is detected from the aforementioned recognition result in order to find an applicable vocabulary 
item. 

8. The speech input interpretation method described under Claim 7 characterized in that 
when multiple applicable vocabulary items are retrieved, the priorities of the applicable 
vocabulary items are evaluated based at least on the phonemic characteristic of the speech 
corresponding to the aforementioned alternative expression. 

9. A speech input interpretation method characterized in that in a speech input 
interpretation method in which input speech is interpreted, and information on applicable 
vocabulary items is output, 

speech recognition and metrical analysis are carried out with respect to the speech input via a 
speech input device in reference to a vocabulary storage means which stores alternative 
expressions obtained by replacing some prescribed normal vocabulary items as the target of 
speech recognition by alternative expressions used to replace arbitrary words as one type of 
vocabulary, and 

the aforementioned alternative expression part is substituted with the aforementioned normal 
vocabulary part based on the result of the aforementioned speech recognition of the 
aforementioned input speech and the result of the aforementioned metrical analysis in reference 
to the aforementioned metrical information storage means which stores information on the 
notations of and metrical information on the aforementioned normal vocabulary items which do 
not contain the aforementioned alternative expressions out of the vocabulary items stored in the 
aforementioned vocabulary storage means. 

10. A speech input interpretation method characterized in that in a speech input 
interpretation method in which an input speech is interpreted by means of speech recognition, 
and information on applicable vocabulary items in a vocabulary storage means which stores 
vocabulary items as the target to be recognized is output during said speech recognition, 

an expression identical to a vocabulary item stored in an alternative expression storage means 
which stores alternative expressions for replacing arbitrary expressions is detected from speech 
information input, and 

the speech recognition of the non-replaced part of the input speech information other than the 
part where the aforementioned alternative expression is detected is carried out while using 
vocabulary items stored in a substitution expression storage means which stores individual words 
obtained by further dividing the vocabulary stored in the aforementioned vocabulary storage 
means as the target of the speech recognition in order to retrieve a vocabulary item appropriate 
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for the replaced expression from the vocabulary items stored in the aforementioned substitution 
expression storage means using the result of said speech recognition. 

1 1 . The speech input interpretation method described under Claim 10 characterized in 
that during the retrieval of the aforementioned vocabulary item, the aforementioned processing 
means carries out the aforementioned speech recognition by the unit of a syllable or a phoneme, 
detects a part where one of the aforementioned normal vocabulary items is added and uttered as a 
part of the alternative expression in reference to the result of said recognition by the unit of a 
syllable or a phoneme, and 

selects an expression which matches the aforementioned detection result with the highest priority 
when retrieving the replaced expression from the vocabulary items stored in the aforementioned 
substitution expression storage means. 

12. The speech input interpretation method described under Claim 1 1 characterized in 
that an expression which matches or approximates the metrical requirement obtained as a result 
of the metrical analysis of the input speech is selected with the highest priority when retrieving 
the replaced expression from the vocabulary items stored in the aforementioned substitution 
expression storage means. 

Detailed explanation of the invention 
[0001] 

Technical field of the invention 

The present invention pertains to a speech input interpreter and a speech input 
interpretation method for interpreting input speech. 

[0002] 
Prior art 

In the recent years, in the case of computer systems, including personal computers, audio 
information can be input in addition to input by means of the conventional mouse and keyboard. 

[0003] 

In addition, due to advances in natural language analysis and natural language generation, 
or speech recognition and speech synthesis technology, or interactive processing technology, 
there is an increasing demand for speech-based interactive systems which allow users to interact 
[with computers] by means of speech input/output; and a variety of speech-based interactive 
systems are being developed, for example, "TOSBURG-II," an interactive system utilizing 
speech input based on a natural speech (Japan Electronics and Information Technology Industries 
Association Theses, Vol. 1J77-D-1 1, No. 8, pp. 1417-1428, 1994). 
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[0004] 

An input method utilized for this kind of speech-based interactive system can be handled 
by anyone in that it does not require any special skill with the keyboard, so that it is expected to 
be used for a social system to be utilized by everybody, resulting in an increasing demand for a 
higher level of speech processing technology. 

[0005] 

Conventionally, to interpret a speech input, the speech of a user is input through a 
microphone, a candidate speech analysis unit is estimated based on signal intensity, for example; 
a characteristic pattern is extracted through an analysis utilizing FFT (fast Fourier transformation) 
of analysis unit items; the extracted pattern is checked against a prepared standard pattern using a 
complex similarity method, DP (dynamic programming) method, or HMM (hidden Markov 
model), for example, in order to recognize the speech input; and a structural analysis and a 
semantic analysis are applied to the speech recognition result in order to extract the content of the 
speech input by the user and the intention of the speech. 

[0006] 

In the past, to carry out speech recognition of the speech input interpretation method of 
said speech-based interactive system, matching with a word or sentence pattern prepared in 
advance was performed. However, with said method, a burden was placed upon a user in that the 
user needed to memorize words or sentences which could be spoken (that is, words or sentences 
said system was able to interpret) accurately. 

[0007] 

Furthermore, when the user memorized only some of the words or sentences which could 
be spoken and input said partially memorized part, it was misrecognized as it was considered a 
speech input different from the prepared pattern. As a result, an operation contradictory to the 
intention of the user was output in many cases, imposing a burden on the user. 

[0008] 

A system for a road guidance task, for example, will be explained as a specific example 
of a social system. When the only information a user has is the portion "Tokyo Hotel" of "Tokyo 
Stayin [transliteration] Hotel," and "Tokyo something Hotel" is input in an attempt to extract 
information pertaining to said hotel, because it is different from name patterns of actually 



existing hotels prepared in the system in advance, a recognition error occurs, and information 
contradictory to the intention of the user is presented, providing no service to the user at all. 

[0009] 

In addition, if only the rhythms of words or sentences which the user could utter (or those 
expected to be registered in the system without a doubt) were stored, when another word or a 
sentence which had the same rhythm as that of said word or the sentence was input, the 
conventional system could not accept it as a proper input, resulting in a recognition error. Thus, 
the operation intended by the user was never carried out, resulting in a burden on the user. 

[0010] 

Similarly, using the system for a road guidance task as a specific example of a social system, 
assume that when a user attempts to obtain information pertaining to "Marunoguchi Hotel," the 
rhythm of "Marunoguchi Hotel" and the partial information ". . . Hotel" are the only 
information said user has. In such case, even when the user utters "lalalalala Hotel" or 
"honyalalala* Hotel" or "talalalala Hotel" to mean "something Hotel" using the rhythm of 
"Marunoguchi Hotel" carefully (or by imitating it) in an attempt to extract information pertaining 
to said hotel, a recognition error occurs, and information contradictory to the intention of the user 
is presented, providing no service to the user at all. 

[0011] 

As described above, with the conventional speech input interpretation method, because 
only those patterns of words or sentences prepared in advance could be understood, a great 
burden was imposed on users. 

[0012] 

Problems to be solved by the invention 

As described above, when the conventional speech input interpretation method is applied 
to a device involving a speech input, because word or sentence patterns which can be accepted as 
a speech input are restricted to those registered in advance, a user needs to memorize the 
sentences he/she can utter accurately, resulting in the problem of an increasing burden on the user. 



* [Translator's note: Transliteration of a nonsense word.] 
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[0013] 

In addition, even when the user remembers only part of a word or a sentence he/she can 
utter and has input said part he/she remembers, it is considered to be a speech input different 
from the prepared pattern, resulting in a recognition error. As a result, an operation contradictory 
to the intention of the user was output in many cases, resulting in an increased burden on the user. 

[0014] 

In addition, when the user remembers only the rhythm of a word or a sentence he/she can 
utter, the conventional system cannot accept it as a proper input, a recognition error occurs, and 
the operation intended by the user is never carried out, resulting in an increased burden on the 
user. 

[0015] 

The present invention was made in consideration of the aforementioned situation, and its 
purpose is to present a speech input interpreter capable of interpreting [a speech input] correctly 
in order for an application part to operate properly without requiring the user to memorize words 
and sentences he/she can utter accurately. 

[0016] 

In addition, the present invention aims to present a speech input interpreter capable of 
restraining interpretation errors in order to direct an output of the speech input device toward the 
user's intention even when the user remembers only part of a word or a sentence he/she is 
allowed to utter. 

[0017] 

In addition, the present invention aims to present a speech input interpreter and a speech 
input interpretation method by which interpretation errors can be restrained in order to direct an 
output of the speech input device toward the user's intention even when the user remembers only 
part or the rhythm of a word or a sentence he/she is allowed to utter. 

[0018] 

Means to solve the problems 

The present invention (Claim 1) is characterized in that in a speech input interpreter 
which interprets input speech and outputs information on applicable vocabulary items, it is 
equipped with a means which stores first information pertaining to normal vocabulary items and 
second information which considers the possibility that some of said normal vocabulary items 
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may be replaced by prescribed alternative expressions during speech input, a means for speech 
recognition of the input speech, a means which detects the aforementioned alternative expression 
from the result of the aforementioned speech recognition based on the aforementioned second 
information, and a means which runs a query in the aforementioned first information based at 
least on the vocabulary items other than said alternative expression included in the 
aforementioned input speech recognition result when the aforementioned alternative expression 
is detected from the aforementioned recognition result by said means in order to find said 
applicable vocabulary item. 

[0019] 

Preferably, a means which evaluates the priorities of applicable vocabulary items based at 
least on the phonemic characteristic of the speech corresponding to the aforementioned 
alternative expression when multiple applicable vocabulary items are retrieved may be further 
provided. 

[0020] 

The present invention (Claim 3) is characterized in that in a speech input interpreter 
which interprets an input speech and outputs information on applicable vocabulary items, it is 
equipped with a vocabulary storage means which stores alternative expressions obtained by 
replacing some of prescribed normal vocabulary items as the target of the speech recognition by 
alternative expressions used to replace arbitrary words as one type of vocabulary item, a metrical 
information storage means which stores information on the notations of and metrical information 
on the aforementioned normal vocabulary items which do not contain the aforementioned 
alternative expressions out of the vocabulary items stored in the aforementioned vocabulary 
storage means, a speech analysis means which carries out speech recognition and metrical 
analysis of a speech input through a speech input device in reference to the aforementioned 
vocabulary storage means, and a substitution expression verification means which replaces the 
aforementioned replaced part by the aforementioned normal vocabulary item based on the result 
of the aforementioned speech recognition of the aforementioned input speech and the result of 
the aforementioned metrical analysis by the aforementioned speech analysis means in reference 
to the aforementioned metrical information storage means. 

[0021] 

With the present invention, even when the user does not remember the vocabulary items 
stored in the vocabulary storage means clearly, an unclear part can be input through speech using 
an alternative expression, and an appropriate expression corresponding to the alternative 



expression input is retrieved so as to substitute it with an appropriate vocabulary item which does 
not contain the alternative expression. 

[0022] 

The present invention (Claim 4) is characterized in that in a speech input interpreter 
equipped with a means which analyzes a speech input from a speech input device for speech 
recognition and outputs a speech analysis result including a speech recognition result and a 
vocabulary storage means which stores vocabulary items as the target to be recognized during 
said speech recognition, it is equipped with an alternative expression storage means which stores 
alternative expressions for replacing arbitrary expressions, an alternative expression detection 
means which detects the same expressions as the aforementioned vocabulary items stored in the 
aforementioned alternative expression storage means according to speech information input, a 
substitution expression storage means which stores individual words obtained by further dividing 
the vocabulary stored in the aforementioned vocabulary storage means, and a processing means 
which carries out the speech recognition of said non-replaced part of the input speech 
information other than the part where the aforementioned alternative expression is detected by 
the aforementioned alternative expression detection means while using the vocabulary items 
stored in the aforementioned alternative expression storage means as the target of the speech 
recognition and retrieves a vocabulary item appropriate for the replaced expression from the 
vocabulary items stored in the aforementioned substitution expression storage means using the 
result of said speech recognition. 

[0023] 

With the present invention, even when the user does not remember the vocabulary items 
stored in the vocabulary storage means clearly, an unclear part can be input through speech using 
an alternative expression, and an expression which replaces an arbitrary expression can be 
detected from the speech input so as to retrieve an appropriate expression corresponding to the 
alternative expression detected. 

[0024] 

Preferably, the aforementioned processing means may be configured as such that it carries 
out the aforementioned speech recognition by the unit of a syllable or a phoneme, detects a part 
where one of the aforementioned normal vocabulary items is added and uttered as a part of the 
alternative expression in reference to the result of said recognition by the unit of a syllable or a 
phoneme, and selects an expression which matches the aforementioned detection result with the 
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highest priority when retrieving the replaced expression from the vocabulary items stored in the 
aforementioned substitution expression storage means. 

[0025] 

As a result, a more appropriate expression adaptable to information on a partially correct 
utterance in a speech input containing the partially correct utterance within the alternative 
expression used by the user can be retrieved. 

[0026] 

Preferably, the aforementioned alternative expression detection means may be configured 
as such that it carries out metrical analysis of the input speech, and the aforementioned 
processing means selects an expression which matches or approximates the metrical requirement 
obtained as a result of the aforementioned analysis with the highest priority when retrieving the 
replaced expression from the vocabulary items stored in the aforementioned substitution 
expression storage means. 

[0027] 

The present invention (Claim 7) is characterized in that in a speech input interpretation 
method in which an input speech is interpreted, and information on applicable vocabulary items 
is output, speech recognition is carried out with respect to the input speech, an alternative 
expression is detected according to the aforementioned speech recognition result based on 
information pertaining to normal vocabulary items which take into consideration of the 
possibility that some of the prescribed normal vocabulary items may be replaced by prescribed 
alternative expressions during the speech input, and a query is run in the information pertaining 
to the prescribed normal vocabulary items based at least on the vocabulary items other than said 
alternative expression included in the aforementioned input speech recognition result when the 
aforementioned alternative expression is detected from the aforementioned recognition result in 
order to find an applicable vocabulary item. 



[0028] 

Preferably, [the method] may be configured as such that when multiple applicable 
vocabulary items are retrieved, the priorities of the applicable vocabulary items are evaluated 
based at least on the phonemic characteristic of the speech corresponding to the aforementioned 
alternative expression. 
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[0029] 

The present invention (Claim 9) is characterized in that in a speech input interpretation 
method in which an input speech is interpreted, and information on applicable vocabulary items 
is output, speech recognition and metrical analysis of the speech are carried out with respect to 
the speech input via a speech input device in reference to a vocabulary storage means which 
stores alternative expressions obtained by replacing some of prescribed normal vocabulary items 
as the target of speech recognition by alternative expressions used to replace arbitrary words as 
one type of vocabulary, and the aforementioned alternative expression part is substituted with the 
aforementioned normal vocabulary part based on the result of the aforementioned speech 
recognition of the aforementioned input speech and the result of the aforementioned metrical 
analysis in reference to the aforementioned metrical information storage means which stores 
information on the notations of and metrical information on the aforementioned normal 
vocabulary items which do not contain the aforementioned alternative expressions out of the 
vocabulary items stored in the aforementioned vocabulary storage means. 



[0030] 

The present invention (Claim 10) is characterized in that in a speech input interpretation 
method in which an input speech is interpreted by means of speech recognition, and information 
on applicable vocabulary items in a vocabulary storage means which stores vocabulary items as 
the target to be recognized is output during said speech recognition, an expression identical to a 
vocabulary item stored in an alternative expression storage means which stores alternative 
expressions for replacing arbitrary expressions is detected from input speech information, and the 
speech recognition of the non-replaced part of the input speech information, other than the part 
where the aforementioned alternative expression is detected, is carried out while using 
vocabulary items stored in a substitution expression storage means which stores individual words 
obtained by further dividing the vocabulary stored in the aforementioned vocabulary storage 
means as the target of the speech recognition in order to retrieve a vocabulary item appropriate 
for the replaced expression from the vocabulary items stored in the aforementioned substitution 
expression storage means using the result of said speech recognition. 



[0031] 

Preferably, [the method] may be configured as such that during the retrieval of the 
aforementioned vocabulary item, the aforementioned processing means carries out the 
aforementioned speech recognition by the unit of a syllable or a phoneme, detects a part where 
one of the aforementioned normal vocabulary items is added and uttered as a part of the 
alternative expression in reference to the result of said recognition by the unit of a syllable or a 
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phoneme, and selects an expression which matches the aforementioned detection result with the 
highest priority when retrieving the replaced expression from the vocabulary items stored in the 
aforementioned substitution expression storage means. 

[0032] 

Preferably, [the method] may be configured as such that an expression which matches or 
approximates the metrical requirement obtained as a result of the metrical analysis of the input 
speech is selected with the highest priority when retrieving the replaced expression from the 
vocabulary items stored in the aforementioned substitution expression storage means. 

[0033] 

With the present invention, when a function to detect a wildcard expression as a 
replacement for a clear expression and a function to retrieve said replaced appropriate expression 
for substitution are added, or when a speech analysis function involving a vocabulary storage 
means containing a vocabulary item actually substituted with the wildcard expression and a 
function to retrieve said replaced appropriate expression for substitution are added, even when 
the user remembers only some of vocabulary items he/she is allowed to utter, a speech input 
containing the wildcard expression can be accepted in order to interpret said speech input. 

[0034] 

In addition, with the present invention, even when the user remembers only the rhythm of 
a vocabulary item he/she is allowed to utter, a speech input containing a wildcard expression 
corresponding to it can be accepted so as to interpret said speech input. 

[0035] 

As such, the present invention offers a great practical effect in that a flexible speech input 
interpreter capable of accepting and interpreting a speech input even when a user does not clearly 
remember a vocabulary item a speech input device can accept. 

[0036] 

Embodiments of the invention 

Embodiments of the present invention will be explained below with reference to Figures. 

[0037] 

First embodiment 

First, a first embodiment of the present invention will be explained. 
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[0038] 

An example configuration of the speech input interpreter pertaining to the present 
invention is shown in Figure 1 . As shown in Figure 1 , speech input interpreter 1 of the present 
embodiment is equipped with speech analysis part 101, vocabulary storage part 102, substitution 
expression verification part 103, and metrical information storage part 104. Furthermore, an A/D 
converter for converting input speech from an analog signal to a digital signal may be provided 
either inside of speech input interpreter 1 or on the side of speech input device 100. 

[0039] 

Speech analysis part 101 is connected to substitution expression verification part 103, 
vocabulary storage part 102, and speech input device 100, such as a microphone; whereby, 
speech recognition of continuous words is carried out while targeting the vocabulary stored in 
vocabulary storage part 1 02 using a system of the kind disclosed in "Algorithms for Speech 
Recognition of Continuous Words and Continuous Syllables Based on a Pattern Matching 
Method" (Japan Electronics and Information Technology Industries Association Theses, Vol. 
J-66-D, [No.] 6, pp. 637-644), for example. Furthermore, speech is analyzed based on 
information on its pitch pattern in order to generate a metrical parameter using a system of the 
kind disclosed in "Keyword Spotting Utilizing Pitch Pattern Information" (Collection of lectures 
by the Acoustical Society of Japan, September Heisei 8[1996], pp. 29-30), for example. Then, 
the information shown in Figure 4 is given to substitution expression verification part 103. Here, 
the system for speech recognition of continuous words and the method for generating the 
metrical parameter are not restricted to those described above, and other systems may also be 
utilized 

[0040] 

Vocabulary storage part 102 as a part for storing vocabulary items as the target of speech 
recognition is connected to speech analysis part 101 . It stores information of the kind shown in 
Figure 2 with respect to each normal vocabulary item (in this case, there is no information 
pertaining to any wildcard expression in Figure 2). In addition, it stores information of the kind 
shown in Figure 2 regarding each normal vocabulary item obtained by substituting part of the 
normal vocabulary item with a wildcard expression, that is, an expression substituted with 
several arbitrary words such as "something" or "honyalala." 
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[0041] 

While the details of the information in Figure 2 will be described later, the notation of 
format of "representation" information will be discussed first. Because a recognition result 
cannot be expressed as a series of multiple words during the speech recognition of continuous 
words by speech analysis part 1 01 , the divisions between said words are indicated using the 
symbol "/" (slash). In addition, the symbol "/" will be used to indicate the divisions between said 
words in the following explanation, too. 

[0042] 

In addition, either multiword substitution words, such as "something," which are 
considered to substitute several words or rhythmic words, such as "honyalala," which are 
considered to indicate the rhythms of expressions to be substituted, or both, are defined as 
wildcard expressions to be used. Specific contents and kinds of the multiword substitution words 
and the rhythmic words to be used may be decided according to the system as needed. 

[0043] 

An example vocabulary generated from "Tokyo Stayin Hotel," the wildcard expression 
"something" as a multiword substitution word, and the rhythmic word "honyalala is shown in 
Figure 3. Here, it is clear that vocabulary items obtained by substituting "Tokyo," "Stayin," 
and/or "Hotel" with the wildcard expression are generated, and particularly that the rhythmic 
word "honyalala" is extended to the same length as that of the expression substituted (in this case, 
the length is adjusted by the number of "la"). 

[0044] 

Figure 2 is a list of information stored in vocabulary storage part 102. A case involving 
the vocabulary item "Tokyo honyalala Hotel" is shown therein. "Representation" information 
refers to information indicating the character string for said vocabulary item. In the case of the 
example in Figure 2, it is stored as a representation comprising 3 continuous words as in 
"Tokyo/honyalala/Hotel." "Presence/absence of wildcard expression" information refers to 
information which indicates whether the aforementioned wildcard expression is included in said 
vocabulary item or not. In this case, "honyalala" corresponds to the wildcard expression, and 
"Yes" is stored accordingly. "Expression type" information refers to information which indicates 
whether each of the words contained in said vocabulary item is a wildcard expression or a 
non-wildcard expression. "Replace" is given to a word of wildcard expression, and "OK" is 
given to a non-wildcard expression. In said example, because the words "Tokyo" and "Hotel" are 
non-wildcard expressions, and "honyalala" is a wildcard expression, (OK/Replace/OK) is given. 
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"Wildcard expression type" information refers to information which indicates the wildcard 
expression contained in a given vocabulary item is a multiword substitution word or information 
representing a rhythmic word. In this case, because "honyalala" is defined as a rhythmic word, 
"Rhythmic word" is stored. "Speech recognition parameter" information is used to describe the 
necessary parameters used by speech analysis part 101 for speech recognition (since the speech 
recognition method used here is not intrinsic to the present invention, a detailed explanation of 
said parameters will be omitted). 

[0045] 

Figure 4 shows a list of information given from speech analysis part 101 to substitution 
expression verification part 103. The case involving the vocabulary item "Tokyo honyalala 
Hotel" is also shown. "Recognition result" information refers to information indicating the result 
a representation for the continuous word recognized by speech analysis part 101. In the case of 
the example in Figure 4, "Tokyo/honyalala/Hotel" is shown as the recognition result of the 
speech signal input. "Word utterance time" information refers to information indicating the 
utterance time of each word obtained during the continuous word recognition by speech analysis 
part 101. (650 msec/820 msec/510 msec) is shown in said example, and these numbers indicate 
the utterance times corresponding to "Tokyo," "honyalala," "Hotel," respectively. "Metrical 
parameter " information refers to information indicating the metrical parameter analyzed by 
speech analysis part 101 . While said information takes different forms depending on the metrical 
parameter analysis means used, a case in which changes in the intonation or the basic frequency 
over time is used is shown here. In this case, a would-be-obtained parameter is shown 
schematically. The arrow symbol "— >" used in Figure 4 indicates the intonation of said 
expression schematically; wherein, arrows at the top indicates the high portion of the intonation, 
and arrows at the bottom indicate the low portions of the intonation. "Presence/absence of 
wildcard expression" information refers to information which indicates whether the 
aforementioned wildcard expression was included in the input speech or not. In this case, 
because "honyalala" corresponds to the wildcard expression, "Yes" is output. "Expression type" 
information refers to information which indicates whether each of the words contained in said 
vocabulary item is a wildcard expression or a non-wildcard expression. Said information can be 
obtained in reference to "expression type" information in Figure 2 pertaining to the applicable 
vocabulary item, and its notation method is identical to that of "expression type" information in 
Figure 2. In the case of the example in Figure 4, because "Tokyo" and "Hotel" are non-wildcard 
expressions, and "honyalala" is a wildcard expression, the information is given as 
(OK/Replace/OK). "Presence/absence of wildcard expression" information refers to information 
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used to identify whether a wildcard expression is a multiword substitution word or a rhythmic 
word. In this case, because "honyalala" is a rhythmic word, "Rhythmic word" is output. 

[0046] 

Substitution expression verification part 103 is connected to speech analysis part 101 and 
metrical information storage part 104; whereby, when a wildcard expression is detected, it finds 
an appropriate expression corresponding to said wildcard expression. Details of said part will be 
described later. 

[0047] 

Metrical information storage part 104 is connected to substitution expression verification 
part 103; whereby, it stores information of the kind shown in Figure 5 pertaining to vocabulary 
items not containing any wildcard expression out of the vocabulary items stored in vocabulary 
storage part 102. 

[0048] 

Figure 5 is a list of information stored in metrical information storage part 104. A case 
involving "Tokyo honyalala Hotel" is shown therein. "Representation" information refers to 
information indicating the representation of said vocabulary item. "Standard time" information 
indicates the utterance time of the sample expression stored. If said vocabulary item comprises 
continuous words and can thus be divided, utterance time for each word is stored. Notation 
method of said information is identical to that of "word utterance time" information in Figure 4. 
"Metrical" information indicates metrical information obtained by analyzing the sample 
expression stored. However, the method used to analyze the metrical information must be 
identical to the method used by speech analysis part 101 . In addition, the metrical information 
output from metrical information storage part 1 04 must be in the same format as that used for the 
metrical parameter information given from speech analysis part 101 to substitution expression 
verification part 103. Like Figure 4, metrical information which would be obtained after the 
analysis is shown schematically in the example in Figure 5. 

[0049] 

Figure 6 is a flowchart of the operations of substitution expression verification part 103 
which plays an important role in the present embodiment. The processing flow will be explained 
below with reference to Figure 6. 



[0050] 
StepSlOl 

Here, whether the speech recognition result by speech analysis part 101 contains a 
wildcard expression or not is checked. It can be checked using the "presence/absence of wildcard 
expression" information in Figure 4 given from speech analysis part 101 . If a wildcard 
expression is present, [it advances] to Step SI 02; and if no wildcard expression is present, the 
recognition result is output, and the processing is ended. 

[0051] 
StepS102 

In this step, vocabulary items which match the speech recognition result and can be 
output are selected from metrical information storage part 104. For example, a non-wildcard 
expression part contained in the speech recognition result is obtained in reference to the 
expression type information in the information (Figure 4) given from speech analysis part 101 
utilizing the representation information of the information (Figure 5) stored in metrical 
information storage part 1 04, and vocabulary items which match the condition pertaining to the 
position where said non-wildcard expression is present are selected while using the non-wildcard 
expression part as a condition based on an assumption that a wildcard expression has a length 
longer than one word. 

[0052] 

For example, assuming that the obtained speech recognition result is 
"Tokyo/something/Hotel," and the expression type is "OK/Replace/OK," vocabulary items 
involving the word "Tokyo" at the beginning, the word "Hotel" at the end, and at least 1 word 
between them can be selected as matching vocabulary items; that is, "Tokyo/Stayin/Hotel," 
"Tokyo/Inter */Continental/Hot el," and so forth. 

[0053] 
Step SI 03 

In this step, whether or not the wildcard expression contained in the speech recognition 
result is a multiword substitution word or a rhythmic word is identified. This can be checked 
using the "wildcard expression type" information in Figure 4 given from speech analysis part 101. 
If it is a rhythmic word, [it advances] to Step SI 04; and if it is a multiword substitution word, the 
vocabulary item extracted in Step SI 02 is output, and the processing is ended. Furthermore, if 



* [Editor's note: For the purposes of this patent, "inter" will be considered to be a separate word for "continental."] 
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there are multiple vocabulary items to be output, either some or all of them may be output. This 
processing, that is, multiple answers being presented to let a user make a selection, is decided 
according to processing (200 in the figure) specific to the application at the output destination. 

[0054] 
Step SI 04 

In this step, the "word utterance time" information given from speech analysis part 101 
and the "standard time" information stored in metrical in formation storage part 104 are 
compared in order to further restrict the vocabulary items to be output among the vocabulary 
items extracted in Step SI 02. For example, in the case of "Tokyo/honyalala/Hotel," respective 
ratios between the utterance times for the non-wildcard expression parts" Tokyo" and "Hotel" 
and the standard times for "Tokyo" and "Hotel" in the standard time information pertaining to /8 
the target vocabulary items stored in metrical information storage part 104 are calculated, the 
utterance time for the wildcard part in the input signal is extended using the mean value of said 
ratios, the extended utterance time and the standard time are compared, and only those within a 
given threshold are extracted. Furthermore, if a vocabulary item is not specified through said 
processing, priority order of the vocabulary items to be output can be decided by comparing their 
times. 



[0055] 
Step SI 05 

In this step, a vocabulary item to be output out of the vocabulary items extracted in Step 
SI 04 is decided by comparing the "metrical parameter " information given from speech analysis 
part 101 with the "metrical parameter " information stored in metrical information storage part 
104. For example, DP method based matching is carried out using the method disclosed in 
"Keyword Spotting Utilizing Pitch Pattern Information" (collection of lectures by the Acoustical 
Society of Japan, September Heisei 8[1996], pp. 29-30). Furthermore, although said comparison 
method differs depending on the metrical parameter configured, an arbitrary metrical comparison 
method may be utilized in the present embodiment as long as the configured parameter can be 
utilized. Then, a vocabulary item with the most closely resembling metrical information to that of 
the speech uttered is output before ending the processing. Alternatively, if there are multiple 
candidates, they may be prioritized for output in the order of the resemblance of their metrical 
information. 
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[0056] 

Above are the configuration and the function of substitution expression verification part 
103 and the processing method pertaining to the present invention. 

[0057] 

Next, the aforementioned speech input interpretation method will be explained in further 
detail below. Here, a specific application example of the operations of a map information system 
when speech is input by a user will be explained. 

[0058] 

Assume that information on 4 hotels (Palace Hotel, Tokyo Stayin Hotel, Tokyo 
Marunoguchi hotel, and Tokyo Inter Continental Hotel) is registered to said map information 
system, and the names of the 4 hotels are stored in vocabulary storage part 102. In addition, 
assume that the aforementioned rhythmic word "honyalala" is registered to vocabulary storage 
part 102 as a wildcard expression, and the vocabulary items shown in Figure 7 are registered to 
vocabulary storage part 102 together with vocabulary items generated from the aforementioned 4 
hotels and "honyalala." 

[0059] 

Also, assume that representation information, metrical information, and standard time 
information are obtained from the registered 4 hotel names, and information of the kind shown in 
Figure 8 is stored in metrical information storage part 104. 

[0060] 

Then, assume that a user wants to make an inquiry regarding 'Tokyo Stayin Hotel," but 
he/she does not remember the part "Stayin" clearly, and Inters the speech input "Tokyo honyalala 
Hotel." Here, assume that the wildcard expression "honyalala" is uttered with the rhythm of 
"Stayin" intentionally. 

[0061] 

Operations of the respective parts in the case of the present specific example will be 
described. 

[0062] 

First, speech analysis part 101 recognizes the continuous word using the vocabulary items 
in Figure 7 with respect to the speech input. Then, "Tokyo/honyalala/Hotel" is selected as the 
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result of the recognition, and the information shown in Figure 9 is output to substitution 
expression verification part 1 03 together with utterance time information obtained during the 
recognition processing and metrical information extracted from the input speech. 

[0063] 

Upon receiving said information, substitution expression verification part 103 carries out 
the following processing. 

[0064] 
StepSlOl 

It judges that the recognition result contains a wildcard expression based on the 
"presence/absence of wildcard expression" information received and advances to Step SI 02. 

[0065] 
Step SI 02 

It decides that non-wildcard expressions are "Tokyo" and "Hotel" based on the 
recognition result information "Tokyo/honyalala/Hotel" and the expression type information 
(OK/Replace/OK) and retrieves those which match the condition pertaining to the positions of 
these 2 words from the vocabulary items (Figure 8) registered to metrical information storage 
part 104. In this case, vocabulary items containing "Tokyo" at the beginning, "Hotel" at the end, 
and at least 1 word between them are considered to match the retrieval condition. As such, 
"Tokyo Stayin Hotel," "Tokyo Marunoguchi Hotel " and "Tokyo Inter Continental Hotel" are 
retrieved; and "Palace Hotel" is either excluded as a candidate to be output or considered as a 
candidate with a lower priority. 

[0066] 
Step SI 03 

It decides that the wildcard expression "honyalala" is a rhythmic word based on the 
wildcard expression type information received and advances to Step SI 04. 

[0067] 
Step SI 04 

Of the vocabulary items selected in Step SI 02, the standard time information (Figure 8) 
on "Tokyo Stayin Hotel" and the word utterance time information given from speech analysis 
part 101 are compared first. For example, ratios (standard time information/word utterance time 
information) are calculated with respect to the wildcard expressions "Tokyo" and "Hotel," 
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"Tokyo": 700/650 = 1.0769 and "Hotel": 550/510 = 1.0784 results. The average of these ratios is 
calculated, and the numeric value (1 .0777) obtained as a result is used as an expansion factor for 
handling the input time and the standard time in metrical information storage part 104 on the 
same scale. As such, after the "honyalala" part corresponding to the wildcard expression is 
extended, the input time for the wildcard expression part becomes 820 msec x 1 .0777 = 884 
msec Next, the standard time for the "Stayin" part, which is located between "Tokyo" and 
"Hotel" and considered to have been replaced by the wildcard expression, becomes 900 msec 
Then, these 2 input times are compared (for example, threshold processing) in order to check 
whether the times for the wildcard expression part match or not. Results of the aforementioned 
calculation pertaining to the vocabulary items selected in Step SI 02 are shown in Figure 10. 

[0068] 

Here, because "Inter/Continental" part of "Tokyo Inter Continental Hotel" is considered 
to have been replaced by "honyalala," 650 + 1050 = 1700 msec corresponding to "Inter" and 
"Continental" out of the standard time (700 msec/650 msec/1050 msec/550 msec) is considered 
the standard time corresponding to the wildcard expression "honyalala." Then, the difference 
between the time after the expansion and the standard time is calculated, and those whose 
absolute value is greater than a given threshold are excluded as candidates to be output. 
Assuming that said threshold is 100 msec, "Tokyo Inter Continental Hotel" is either excluded as 
a candidate to be output or considered as a candidate with a lower priority. 

[0069] 
Step SI 05 

Metrical information matching is applied to "Tokyo Stayin Hotel" and "Tokyo 
Marunoguchi Hotel" which have not been excluded during the aforementioned processing. Then, 
either a vocabulary item with metrical information close to the metrical information given from 
speech analysis part 101 or the vocabulary item with the higher priority is output as a result. Here, 
the metrical information on "Tokyo Stayin Hotel" is judged to be closer to the rhythm of the 
input speech, "Tokyo Stayin Hotel" is output as the vocabulary item with the higher priority, and 
an appropriate processing (200 in the figure) specific to the application of the output destination 
is carried out. In addition, if the application-specific processing can be applied to multiple 
candidates, "Tokyo Marunoguchi Hotel" is output as a lower-priority candidate, and "Tokyo Inter 
Continental Hotel" and "Palace Hotel" are also output in said order as even lower-priority 
candidates if necessary. 
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[0070] 

Now, the processing to be carried out when 'Tokyo honyalala Hotel" is input in the form 
of a speech is completed. 

[0071] 

It is clear from the aforementioned explanation that with the speech input interpreter 
pertaining to the present embodiment, even when a user does not remember the name "Tokyo 
Stayin Hotel" clearly, he/she can Inter the speech input of "Tokyo honyalala Hotel" using the 
wildcard expression for the unclear part in order to have information on appropriately interpreted 
name output to the application part, and that the speech information the user input is utilized 
more effectively in that the user can input the rhythm which he/she knows but cannot be 
expressed by characters in the form of "Tokyo honyalala Hotel" using the wildcard expression in 
order for the system pertaining to the present embodiment to interpret the utterance time 
information and rhythmic information so as to give the priority to "Tokyo Stayin Hotel" over 
"Tokyo Inter continental Hotel" and "Tokyo Marunoguchi Hotel" which are names of the same 
format, that is, "Tokyo ... Hotel." 

[0072] 

Second embodiment 

Next, a second embodiment of the present invention will be explained. 

[0073] 

Although the speech recognition system utilized continuous word recognition in the first 
embodiment, the speech recognition system can be applied even when the continuous word 
recognition is not involved in the present embodiment. 

[0074] 

An example configuration of the speech input interpreter pertaining to the present 
embodiment is shown in Figure 1 1 . As shown in Figure 1 1, speech input interpreter 2 of the 
present embodiment is equipped with speech analysis part 201, vocabulary storage part 202, 
wildcard expression detection part 203, wildcard expression storage part 204, substitution 
expression verification part 205, and substitution expression storage part 206. Furthermore, an 
A/D converter for converting an input speech from an analog signal into a digital signal may be 
provided either inside of speech input interpreter 2 or on the side of speech input device 100. 
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[0075] 

Speech analysis part 201 is connected to substitution expression verification part 205, 
vocabulary storage part 202, and substitution expression storage part 206; whereby, words in a 
speech are recognized using vocabulary items either in vocabulary storage part 202 or 
substitution expression storage part 206 whichever is specified as a speech recognition request 
arrived from substitution expression verification part 205, and the results are output to 
substitution expression verification part 205. In addition, individual syllables are recognized as 
requested by the recognition method, and the results are output to substitution expression 
verification part 205 in the form of a Mauler code string. Here, since the speech recognition 
method used here is not intrinsic to the present invention, their detailed explanation will be 
omitted. 

[0076] 

Vocabulary storage part 202 is a part connected to speech analysis part 201 and 
substitution expression verification part 205 in order to store (normal) vocabulary items as the 
target of speech recognition; whereby, it stores the information shown in Figure 12 regarding the 
respective vocabulary items as the target of speech recognition in a format which can be referred 
to and utilized by speech analysis part 201 and substitution expression verification part 205. 

[0077] 

Figure 12 is a list of information stored in vocabulary storage part 202. Information to be 
stored in vocabulary storage part 202 regarding "Tokyo Stayin Hotel" is shown as an example. 
"Representation character string" information refers to a character string representing vocabulary 
items to be registered. "Mauler code string" information refers to the reading of the 
representation character string expressed in the form of a string of Mauler codes. "Mauler code 
string" information indicates the number of Mauler codes in the Mauler code string stored as 
Mauler code string information. Pitch pattern information on the speech is analyzed using the 
method disclosed in "Keyword Spotting Utilizing Pitch Pattern Information" (collection of 
lectures by the Acoustical Society of Japan, September Heisei 8[1996], pp. 29-30), for example, 
and a metrical parameter configured is stored as "metrical parameter " information. Furthermore, 
the method for generating the metrical parameter is not restricted to the aforementioned system, 
and other systems may also be utilized. In addition, in the case of the example in Figure 12, 
would-be-obtained metrical information is shown schematically. This notation method is 
identical to that in the first embodiment. "Parameter required for speech recognition" information 
is used to describe a parameter necessary for speech recognition by speech analysis part 201 as 
needed for the implementation of the present invention (furthermore, since the speech 
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recognition method used here is not intrinsic to the present invention, detailed explanation of 
said parameter will be omitted here). 

[0078] 

Wildcard expression storage part 204 is connected to wildcard expression detection part 
203; whereby, it stores a wildcard expression as an expression substituted with several arbitrary 
words, such as "something" or "honyalala," in a format which can be referred to and utilized by 
wildcard expression detection part 203. Also, it divides the wildcard expressions to be stored into 
multiword substitution words, such as "something" and "so and so," comprising several words 
used for substitution and rhythmic words, such as "honyalala" and "talalala," which indicate the 
rhythm of an expression to be substituted when storing them. 

[0079] 

Wildcard expression detection part 203 is connected to speech input device 100, such as a 
microphone, wildcard expression storage part 204, and substitution expression verification part 
205; whereby, it detects vocabulary items for the wildcard expressions stored in wildcard 
expression storage part 204 using the method disclosed in "Noise Immunity Learning During 
Speech Recognition Through Word Spotting" (collection of lectures by the Acoustical Society of 
Japan, Vol. J-74-D-II, September 1991, pp. 121-129), for example. Furthermore, the 
aforementioned system does not impose any restriction, and other detection systems may also be 
utilized as long as a specific vocabulary item can be detected. Then, wildcard expression 
detection part 203 gives the processing to substitution expression verification part 205 by giving 
it the information shown in Figure 13. 

[0080] 

Figure 13 is a list of information given from wildcard expression detection part 203 to 
substitution expression verification part 205. A case involving the vocabulary item "Tokyo 
honyalala Hotel" is shown therein. "Presence/absence of wildcard expression" information refers 
to information which indicates whether or not a wildcard expression is detected by wildcard 
expression detection part 203. In this example, "honyalala" corresponds to the wildcard 
expression, and "Yes" is output accordingly. "Original signal" refers to the original signal for the 
speech input; when a wildcard expression is detected, it is separated at the part where said 
wildcard expression is present and given to substitution expression verification part 205. In the 
example, the input "Tokyo honyalala Hotel" is separated by the wildcard expression "honyalala" 
into three parts, namely, "Tokyo," "honyalala," and "Hotel," and given to substitution expression 
verification part 205 in said order. When a wildcard expression is present, "wildcard expression 



position" information indicates which of the separated [parts] of the original signal is the 
wildcard expression in the form of a numeric value. In this example, "honyalala" is found in the 
2nd position of the three parts obtained by separating the signal, and 2 is output accordingly. 
"Wildcard expression type" refers to information which indicates whether the detected wildcard 
expression is a multiword substitution word or a rhythmic word. In this example, "honyalala" is 
considered as a rhythmic word. This differs depending on the information registered to wildcard 
expression storage part 204. "Mauler code string length of wildcard expression" refers to 
information which indicates the number of Mauler codes used for the detected wildcard 
expression when it is a rhythmic word. In this example, the wildcard expression "honyalala" has 
4 as the number of Mauler codes. "Metrical information on wildcard expression" refers to 
information which indicates the rhythm of the detected wildcard expression when it is a rhythmic 
word. It is analyzed based on the pitch pattern information of the speech input and given to 
substitution expression verification part 205. Here, the method used to generate the metrical 
parameter must be such that the metrical parameter generated is in the same format as that used 
for storing in vocabulary storage part 202 or substitution expression storage part 206. 

[0081] 

Substitution expression verification part 205 is connected to wildcard expression 
detection part 203, speech analysis part 201, vocabulary storage part 202, and substitution 
expression storage part 206; whereby, when a wildcard expression is detected, it verifies an 
appropriate expression corresponding to said wildcard expression part. Details of said part will 
be described later. 

[0082] 

Substitution expression storage part 206 is connected to speech analysis part 201 and 
substitution expression verification part 205; whereby, it stores words, such as "Tokyo," 
"Stayin," and "Hotel," further generated as meaningful words from the vocabulary item, for 
example, from "Tokyo Stayin Hotel," stored in vocabulary storage part 202 or words which are 
used to create word combinations, such as "Tokyo Stayin" and "Stayin Hotel," using the same 
format (Figure 12) as that used for vocabulary storage part 202. 

[0083] 

Figure 14 shows an outline of the operations of substitution expression verification part 
205 which plays an important role in the present embodiment. The processing flow will be 
explained below with reference to Figure 14. 
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[0084] 
StepS201 

Whether or not the speech input contains a wildcard expression or not is checked. This 
can be checked using the "presence/absence of wildcard expression" information (Figure 1 3) 
given by wildcard expression detection part 203. If a wildcard expression is present, [it advances] 
to Step S204, or to Step S202 if no wildcard expression is present. 

[0085] 
Step S202 

When a judgment that there is no wildcard expression is made, speech recognition 
processing is carried out as it is. Speech analysis part 201 is requested to carry out word 
recognition with respect to the original signal input using the vocabulary items stored in 
vocabulary storage part 202. 

[0086] 
Step S203 

The speech recognition result output from speech analysis part 201 is given to 
application-specific processing (200 in the figure) or speech analysis processing of a higher level 
before ending the processing. 

[0087] 
Step S204 

When a judgment that there is a wildcard expression is made, how the non-wildcard 
expression parts are uttered and input is checked. For example, a signal for the wildcard 
expression is obtained based on [the part] separated from the original signal and given by 
wildcard expression detection part 203 and the '"wildcard expression position" information, and 
speech analysis part 201 is requested to carry out word recognition using the vocabulary items 
stored in substitution expression storage part 206 with respect to the signals for the non-wildcard 
expression parts (non-wildcard expression parts). The speech recognition result obtained in this 
step will be referred to as a "partial recognition result" in the following explanation. In addition, 
when there is no appropriate vocabulary item in substitution expression storage part 206, a 
decision that there is no partial recognition result corresponding to said non-wildcard expression 
parts is made. 
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[0088] 
Step S205 

Here, whether or not some kind of information is present between the non-wildcard 
expression parts and the wildcard expression part is checked. The purpose of doing so is to 
handle a case in which an utterance contains [a part] added before or after a wildcard expression 
as it is evident in "'Su'* something" when the user knows only the starting point and the ending 
point partially without having clear knowledge of the word pronunciations. When the utterance is 
input in the form of "'Su' something," the wildcard expression detected by wildcard expression 
detection part 203 is "something" unless "su-something" is registered as a wildcard expression in 
wildcard expression storage part 204, so that the 4 su' uttered by the user intended as a wildcard 
expression is treated as if it was a part of a non-wildcard expression. In such case, too, whether or 
not a part handled as a part of a wildcard is present within a non-wildcard expression is 
determined in order to allow it to be processed as a part of the wildcard expression when said 
part does exist. 

[0089] 

First, a buffer for storing a Mauler code string is prepared for each wildcard expression 
part detected. When information is detected as a non-wildcard expression part and a wildcard 
expression part, said buffer is used to store said information in the form of Mauler codes. In 
addition, because the information detected may appear either before or after the wildcard 
expression part, 2 buffers are prepared for each wildcard expression to handle said situation. In 
Step S205, Mauler codes to be input to the buffers are detected for the respective parts of the 
non-wildcard expression parts adjoining the wildcard expression part. Figure 1 5 shows an outline 
of the processing (processing in Step S205 applied to one of the non-wildcard expression parts 
detected. The explanation will continue with reference to Figure 15 hereafter. 

[0090] 
Step S205-1 

In this step, how the non-wildcard expressions are pronounced is checked. For example, 
speech analysis part 201 is requested to carry out speech recognition of a target non-wildcard 
expression part by the unit of a syllable. A Mauler code string output in this step will be referred 
to as a "partial syllable recognition result" in the explanation given below. 



* [Editors note: "Su" is the first syllable of the Japanese pronunciation of "Stayin."] 



[0091] 
Step S205-2 

In this step, whether there is a partial recognition result which corresponds to the current 
target non-wildcard expression or not is checked. If no partial recognition result is found to exist 
as a result, [it advances] to Step S205-3, or to Step 205-4 if a partial recognition result is present. 

[0092] 
Step S205-3 

If there is no partial recognition result which corresponds to the current target 
non- wildcard expression, a judgment that said non- wildcard expression is a shorter expression 
than a vocabulary item in substitution expression storage part 206 can be made. Thus, the entire 
non-wildcard expression is considered as a part of an adjoining wildcard expression, whether 
said non- wildcard expression is found at the front of the wildcard expression or at the end is 
determined, its Mauler codes (string) [are stored] the corresponding buffer, the length equivalent 
to the number of the Mauler codes stored in the buffer is added to the "character string length of 
wildcard expression" information received from wildcard expression detection part 203 if the 
wildcard expression is a rhythmic word, and the <4 wildcard expression position" information is 
decremented by 1 if said non-wildcard expression part is present at the front of the wildcard 
expression part before finishing [the processing]. 

[0093] 

Step S205-4) 

Here, whether or not any words uttered other than the corresponding partial recognition 
result are contained in the current target non-wildcard expression part is checked. For example, 
the length of the Mauler code string for the partial syllable recognition result corresponding to 
the current target non-wildcard expression and the length of the Mauler code string for the partial 
recognition result are compared. As a result, if the Mauler code string for the partial recognition 
result is longer, or they are equal, advances to Step S205-5, or to Step 205-6 if the Mauler code 
string for the partial syllable recognition result is longer. 

[0094] 
Step S205-5 

A judgment that the current target non- wildcard expression does not have any more 
information than the corresponding partial recognition result is made, and [the processing] is 
ended without inputting anything into the buffer. 
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[0095] 
Step S205-6 

Because the Mauler code string for the partial recognition result corresponding to the 
current target non-wildcard expression part is shorter than the Mauler code string for the partial 
syllable recognition result at the same part, a judgment that there is a possibility that a part of the 
wildcard expression may be uttered [of] the current non-wildcard expression in addition to the 
corresponding partial recognition result is made, and to what part of the non-wildcard expression 
part the partial recognition result corresponds is checked. 

[0096] 

For example, as shown in Figure 16, it is obtained by comparing their Mauler code strings 
by checking the Mauler code string for the partial recognition result against the Mauler code 
string for the partial syllable recognition result in sequence. In Figure 16, although the partial 
recognition result "Tokyo" (Mauler code string tc to-o-kyo-o"*) and the partial syllable recognition 
result 4t to-o-kyo-o-su" are compared, because the length of the Mauler code string for the partial 
recognition result is 4, and the length of the Mauler code string for the partial syllable recognition 
result is 5, 2 patterns in which either 'Ho" or "o" (first o) of "to-o-kyo-o-su" are selected as the 
code used for the matching are feasible for the partial recognition result. When the partial 
recognition result is even shorter, a pattern in which that after "kyo" is selected as the beginning 
is also created. 

[0097] 

Then, which of the patterns is the best for the matching is decided, and what constitutes 
the "remaining" part is decided. Said "remaining" part is considered as a part which should be 
taken as a part of the wildcard expression part contained in the non-wildcard expression. In terms 
of a method for deciding the remaining part, when the number of matched Mauler codes is used 
as a reference, the part where the largest number of matching Mauler codes are present is selected 
as the position where the partial recognition result is present, and the part of the partial 
recognition result where the Mauler code string does not fit is extracted as "remaining," for 
example. 

[0098] 

In the case of the example in Figure 16, "su" is extracted as the remaining part. * 



* [Editor's note: This spelling corresponds to the Japanese pronunciation of "Tokyo."] 
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[0099] 

In addition, when the position of the partial recognition result cannot be decided uniquely 
due to the presence of 2 or more patterns by which the number of matching Mauler codes 
becomes the maximum, a judgment that there is no remaining part is made. Alternatively, the 
judgment that there is no remaining part may be made also when the number of matching Mauler 
codes is equal to or lower than a threshold. 

[0100] 
Step S205-7 

Here, whether or not a remaining part was able to be extracted as a result of Step S205-6 
is checked. [It advances] to Step S205-8 if a remaining part is present, or to Step S205-5 if no 
remaining part is present. 

[0101] 
Step S205-8 

Here, whether or not the remaining part as a result of Step S205-6 is present at a position 
adjoining the wildcard expression part is checked. In the case of the example in Figure 16, 
because the remaining part "su" is present immediately before the wildcard expression 
"something," a judgment that the remaining part "su" is present at a position adjoining 
"something" is made. To the contrary, when "something" is present before "to-o-kyo-o-su," a 
judgment that the remaining "su" found at the end of "to-o-kyo-o-su" is not adjoining 
"something" is made. In this case, if the "to" is "to-o," a judgment that a remaining part is 
present immediately after the wildcard expression "something" can be made. If a remaining is 
present at the adjoining part, it advances to Step S205-9. If no remaining is present at the 
adjoining part, it advances to Step S205-5. 

[0102] 
Step S205-9 

Here, because the remaining part extracted in Step S205-6 is adjoining the wildcard 
expression, said extracted remaining part is considered as a part of the adjoining wildcard 
expression, whether said remaining part is present at the beginning or the end of the adjoining 
wildcard expression is determined, its Mauler codes (string) are stored into the corresponding 
buffer, and [the length] equivalent to the number of the Mauler codes stored in the buffer is 
added to the "character string length of wildcard expression" information received from wildcard 
expression detection part 203 if the wildcard expression part is a rhythmic word before ending 
[the processing]. 
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[0103] 

As an alternative to the aforementioned method, speech analysis part 201 may be 
provided with the word detection function of wildcard expression detection part 203; whereby, 
Mauler codes (string) to become a part of the wildcard expression in the aforementioned manner 
can be estimated by detecting the word in the speech recognition result obtained in Step S204 out 
of [the part] separated from the original signal, separating the signal remaining at the boundary 
part with the wildcard expression subsequently, and requesting speech analysis part 201 to carry 
out the speech recognition by the unit of a syllable. 

[0104] 
Step S206 

The word corresponding to the wildcard expression part is retrieved from vocabulary 
items stored in substitution expression storage part 206 so as to match the vocabulary item stored 
in vocabulary storage part 202 using the pieces of information obtained through the processing in 
Steps S204 and S205 and the information shown in Figure 13 obtained from wildcard expression 
detection part 203 as retrieval conditions. Figure 17 is a flowchart for the operations to be carried 
out in Step S206. The processing flow will be explained below with reference to Figure 17. 



[0105] 
Step S206-1 

In this step, vocabulary items to be output which match the speech recognition result 
received are selected from vocabulary storage part 202. For example, words which match the 
positional conditions of partial recognition results of non-wildcard expression parts are selected 
utilizing the representation information of the information (Figure 12) stored in vocabulary 
storage part 202 while using non-wildcard expression parts as conditions and assuming that a 
wildcard expression is longer than 1 word. Then, a part replaced by the wildcard expression 
comprising the vocabulary item selected is retrieved from the expression stored in substitution 
expression storage part 206. For example, assuming that the partial recognition results obtained 
are 'Tokyo" and Hotel," and the sequence of "Tokyo (wildcard expression) Hotel" is found 
based on the arrangement of the separated [parts of] the original signal and the information on 
the position of the wildcard expression, "Tokyo Stayin Hotel," for example, in which the word 
"Tokyo" is present at the beginning, the word "Hotel" is present at the end, and at least 1 word is 
present between them, is selected as a matching vocabulary item. Then, the expression "Stayin," 
for example, is retrieved for the part replaced by the wildcard expression from substitution 
expression storage part 206. 
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[0106] 
Step S206-2 

In this step, the expressions extracted in Step S206-1 are further restricted using the 
Mauler codes (string) stored in the buffer in Step S205 as a retrieval condition. 

[0107] 
Step S206-3 

In this step, whether the wildcard expression contained in the speech recognition result is 
a multiword substitution word or a rhythmic word is determined. This can be checked using the 
"wildcard expression type" information in Figure 13 received from wildcard expression detection 
part 203. Then, if it is a rhythmic word, it advances to Step S206-4. If it is a multiword 
substitution word, the expression extracted in Step S206-2 and the normal vocabulary item 
comprising the partial recognition result are output, and the processing is ended. Furthermore, if 
multiple vocabulary items to be output are present, some or all of them may be output, and 
processing for presenting multiple answers to let a user make a selection is decided according to 
processing (200 in the figure) specific to the application at the output destination. 

[0108] 
Step S206-4 

In this step, the Mauler code string length information of the wildcard expression given 
by wildcard expression detection part 203 and the Mauler code length information stored in 
substitution expression storage part 206 are compared with respect to the vocabulary items 
extracted in Step S206-1 in order to further restrict the vocabulary items output. For example, 
only the items which indicates a Mauler code string length difference less than a given threshold 
are extracted. Furthermore, if the vocabulary items are not restricted during said processing, the 
vocabulary items may be prioritized for output. 

[0109] 
Step S206-5 

In this step, the "metrical parameter " information received from speech analysis part 101 
and the "metrical parameter " information stored in metrical information storage part 104 are 
compared with respect to the vocabulary items extracted in Step S206-4 in order to decide a 
vocabulary item to be output. For example, DP method based matching is carried out using the 
method disclosed in "Keyword Spotting Utilizing Pitch Pattern Information" (collection of 
lectures by the Acoustical Society of Japan, September Heisei 8[1996], pp. 29-30). Furthermore, 
although said comparison method differs depending on the metrical parameter configured, an 
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arbitrary metrical comparison method may be utilized in the present embodiment as long as the 
configured parameter can be utilized. Then, a vocabulary item with the metrical information most 
closely resembling that of the speech uttered is output before ending the processing. Alternatively, 
if (here are multiple candidates, they may be prioritized for output in the order of the resemblance 
of their metrical information. 

[0110] 

Above are the configurations and the function of substitution expression verification part 
205 and the processing method pertaining to the present invention. 

[0111] 

Next, the aforementioned speech input interpretation method will be explained in further 
detail below. Here, the example of the map information system used to explain the first 
application example will be used to explain a specific application example of its operations when 
speech is input by a user. 

[0112] 

Assume that information on 4 hotels (Tokyo Stayin Hotel, Tokyo Marunoguchi hotel, 
Palace Hotel, and Tokyo Inter Continental Hotel) near Tokyo railroad station is registered in said 
map information system, and the information shown in Figure 18 regarding said 4 hotels and the 
necessary parameters for their speech recognition are stored in vocabulary storage part 202. Then, 
they are registered into substitution expression storage part 206. Words separated from said 
vocabulary items and expressions as combinations of the words are shown in Figure 19. 

[0113] 

In addition, assume that the multiword substitution word "something" is stored in 
wildcard expression storage part 204 as a wildcard expression. 

[0114] 

Next, assume that a user wants to make an inquiry regarding "Tokyo Stayin Hotel," but 
he/she does not remember the part "Stayin" clearly, and Inters the speech input "Tokyo 
su-something Hotel." 
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[0115] 

In order to make the notation clear, a waveform signal before a speech recognition result 
is obtained will be expressed by (...) as in (signal), and a character string after a speech 
recognition result is obtained will be expressed by (. . .) as in (character string). 

[0116] 

Upon receiving said input, a wildcard expression is detected at wildcard expression 
detection part 203 first. The signal (Tokyo su-something Hotel) contains the wildcard expression 
(something), and it is detected as a wildcard expression. Then, the information of the kind shown 
in Figure 20 is given to substitution expression verification part 205. 

[0117] 

Processing to be carried out by substitution expression verification part 205 is as follows. 

[0118] 
Step S201 

The point that a wildcard expression is present is confirmed based on the 
presence/absence of wildcard expression information. 

[0119] 
Step S204 

(to-o-kyo-o-su) and (ho-te-ru*) are found to be the necessary parts to be recognized based 
on the separated [parts of] original signal and the wildcard expression position information. Then, 
speech analysis part 201 is requested to carry out word recognition with respect to said 2 [parts of 
the] signal using the vocabulary items stored in substitution expression storage part 206. Assume 
that "Tokyo" is obtained as a partial recognition result as a result of the recognition of 
(to-o-kyo-o-su), and "Hotel" as a result of the recognition of (ho-te-ru). 

[0120] 
Step S205 

The [partial] signal (to-o-kyo-o-su) is processed first. 



* [Editor's note: This spelling corresponds the Japanese pronunciation of "hotel."] 



[0121] 
StepS205-l 

Speech analysis part 201 is requested to recognize the [partial] signal l(to-o-kyo-o-su) by 
the unit of a syllable. Assume that the Mauler code string "to-o-kyo-o-su" is obtained as a result. 

[0122] 
Step S205-2 

Because "Tokyo" has been obtained as a result of the recognition of the [partial] signal 
(to-o-kyo-o-su), it advances to Step S205-4. 

[0123] 
Step S205-4 

The Mauler code string length of the Mauler code string "to-o-kyo-o-su" is 5. Also, 
assume that the partial recognition result "Tokyo" is stored into substitution expression storage 
part 206 in the manner shown in Figure 2 1 . 

[0124] 

Because the partial syllable recognition result "to-o-kyo-o-su" obtained from the signal 
input is longer than said Mauler code string length, it advances to Step S205-6. 

[0125] 
Step S205-6 

Figure 16 emerges when the syllable recognition result "to-o-kyo-o-su" and the Mauler 
code string "to-o-kyo-o" of the partial recognition result "Tokyo," and the Mauler code "su" is 
detected as a remaining part. 

[0126] 
Step S205-7 

Because the Mauler code "su" is detected as a remaining part, it advances to Step S205-8. 

[0127] 
Step S205-8 

Because the remaining Mauler code "su" is located at the end of the syllable recognition 
result "to-o-kyo-o-su," and the original signal (to-o-kyo-o-su) of said syllable recognition result 
is located immediately before the wildcard expression part (something), the remaining part "su" 
is judged as a part of the wildcard expression. It advances to Step S205-9. 
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[0128] 
Step S205-9 

The Mauler code "su" is input to the buffer which stores the pronunciation of the 
beginning part of the wildcard expression. 

[0129] 

Next, the same processing is carried out with respect to the [partial] signal (ho-te-ru). 
Here, assume that no remaining part is found in the partial recognition result "Hotel," and it 
advances to the next step without storing anything into the buffer. 

[0130] 
Step S206 

Here, appropriate vocabulary items are retrieved based on the information obtained thus 

far. 

[0131] 
Step S206-1 

"Tokyo (wildcard expression) Hotel" is judged to be the target vocabulary item of the 
speech input based on the original signal information, partial recognition results, and wildcard 
expression position information. "Tokyo Stayin Hotel," "Tokyo Marunoguchi Hotel," and 
"Tokyo Inter Continental Hotel" are selected from the vocabulary items stored in vocabulary 
storage part 202 as vocabulary items which match the aforementioned condition. In addition, 
"Stayin," "Marunoguchi," and "Inter Continental" are selected among the expressions stored in 
substitution expression storage part 206 as candidates to be output as expressions replaced by the 
wildcard expression. At this time, "Palace Hotel" is either excluded as a candidate to be output or 
considered as a candidate with a lower priority. 

[0132] 
Step S206-2 

A judgment that the expression "Stayin" which begins with the Mauler code "su" is 
promising can be made in reference to [the content] stored in the buffer in Step S205. Here, the 
vocabulary item "Tokyo Stayin Hotel" containing "Stayin" becomes promising as a candidate to 
be output. "Tokyo Marunoguchi Hotel" and "Tokyo Inter Continental Hotel" are either excluded 
as candidates to be output or considered as candidates with a lower priority. 
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[0133] 
Step S206-3 

Because it is clear that the wildcard expression ("something") used is a multiword 
substitution word based on the information sent from wildcard expression detection part 203, 
"Tokyo Stayin Hotel" is output as the first candidate. Alternatively, when the application part 
corresponds to multiple candidates, "Tokyo Marunoguchi Hotel" and "Tokyo Inter Continental 
Hotel" are output, and "Palace Hotel" may also be output as a candidate with even an lower 
priority. Then, upon receiving said output, the application-specific processing (200 in the figure) 
carries out appropriate processing. 

[0134] 

Now, the processing of the speech input "Tokyosu-something-hotel" is completed. 

[0135] 

From the explanation given above, it is clear that in the case of the speech input analyzer 
pertaining to the present embodiment, when a user Inters the speech input "Tokyo something 
Hotel" by uttering the specific parts he/she remembers while using a wildcard expression for the 
uncertain part, even though the user does not remember the name "Tokyo Stayin Hotel" clearly, 
it can be interpreted into an appropriate name so as to output the information to the application 
part, and that the speech information input by the user is utilized effectively in that when "Tokyo 
something Hotel" is input while using a wildcard expression for the unclear part in "Tokyo su . . . 
Hotel" on which the user lacks detailed information, "Tokyo Stayin Hotel" is given a higher 
priority than 'Tokyo Marunoguchi Hotel" and "Tokyo Inter Continental Hotel" with the same 
format, that is, "Tokyo ... Hotel." 

[0136] 

As such, with the present device configured in the aforementioned manner, a speech input 
interpreter can be constructed which is capable of operating even when a user does not remember 
correct words or sentences he/she is allowed to utter. 

[0137] 

For example, a speech input interpreter can be constructed by which a recognition error 
can be restrained, and the output by the system for speech input can be directed toward the 
intention of the user even when the user remembers only a portion of acceptable words or a 
sentence. 
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[0138] 

In addition, a speech input interpreter can be constructed by which a recognition error can 
be restrained, and an output of the system for speech input can be directed to the intention of the 
user even when the user remembers only the "rhythm" of acceptable words or a sentence. 

[0139] 

Furthermore, the functions and the effects of the respective embodiments are not 
restricted to the aforementioned examples. For example, an operation error can be avoided by 
presenting a list of the results of the substitution processing at substitution expression verification 
part 103 in the first embodiment, or at substitution expression verification part 205 in the second 
embodiment, in order for the user to make a correct choice. 

[0140] 

In addition, it may be utilized as an input means for a multimodal interface while 
narrowing down the search range and reducing the redundancy of the output in order to reduce 
the burden on the user. 

[0141] 

In addition, it may be utilized as an input means not only for a multimodal interface but 
also for a device involving an arbitrary speech input. In addition, the metrical information may be 
used for the analysis of all speech information input without restricted to the part where a 
wildcard expression is used. 

[0142] 

A device configuration for realizing the processing by the present speech input interpreter 
using software will be explained below with reference to Figure 22. 

[0143] 

In this case, the hardware part of the present speech input interpreter comprises CPU 21, 
RAM 22 for storing necessary programs and data, disk drive device 24, memory device 25, and 
input input/output device 26. 

[0144] 

In the case of the first embodiment, speech analysis part 101, vocabulary storage part 102, 
substitution expression verification part 103, and metrical information storage part 104 in Figure 
1 are configured using programs containing the descriptions of the respective processing steps. 



[0145] 

In the case of the second embodiment, speech analysis part 201 , vocabulary storage part 
202, wildcard expression detection part 203, wildcard expression storage part 204, substitution 
expression verification part 205, and substitution expression storage part 206 in Figure 1 1 are 
configured using programs containing the descriptions of the respective processing steps. 

[0146] 

Furthermore, the information to be stored in each buffer may be formed either integrally 
with a program or separately from the program. 

[0147] 

Said programs containing the descriptions of the respective processing steps are stored in 
RAM 22 as programs for controlling the computer system shown in Figure 22 and executed by 
CPU 21 . CPU 21 carries out arithmetic operations and the control over memory device 25 or 
input input/output device 26 according to the program procedures stored in RAM 22 in order to 
realize desired functions. 

[0148] 

A variety of methods can be used to install the programs into RAM 22. For example, the 
aforementioned programs (programs containing the descriptions of the processing steps carried 
out by speech analysis part 101, vocabulary storage part 102, substitution expression verification 
part 103, and metrical information storage part 104 in Figure 1 and used to control the computer 
system and programs containing the descriptions of the processing steps carried out by speech 
analysis part 201, vocabulary storage part 202, wildcard expression detection part 203, wildcard 
expression storage part 204, substitution expression verification part 205, and substitution 
expression storage part 206 in Figure 1 1 and used to control the computer system) is stored in 
advance on a storage medium (for example, a floppy disk or a removable recording medium such 
as a CD-ROM) which can be read by the computer. Then, as shown in Figure 22, said programs 
are read using a disk drive device appropriate for the recording medium and stored into RAM 22. 
Alternatively, it is installed onto disk drive device 24 once and stored into RAM 22 from said 
device when it is to be executed. 
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[0149] 

In addition, when the recording medium used to store the programs is an IC card, said 
programs can be read using an IC card reader. Furthermore, the programs can be received 
through a prescribed interface device via a network also. 

[0150] 

Furthermore, an application which utilizes the interpretation results may be installed on 
the speech input interpreter, or the speech input interpreter and the device used to install the 
application may be made independent of each other. In addition, the programs for realizing the 
speech input interpreter and the program for realizing the application which utilizes the 
interpretation results may be executed by the same CPU, or they may be executed using CPUs 
provided separately. 

[0151] 

Incidentally, although the first and the second embodiments are described as if they were 
based on the assumption that only 1 wildcard expression would be input, even when multiple 
wildcard expressions are input, they can be handled by generating the corresponding vocabulary 
items at vocabulary storage part 102 and applying the same processing to the respective 
applicable wildcard expression parts at substitution expression verification part 103 in the case of 
the first embodiment, and they can be handled by applying the same processing (that is, 
information on the positions, types, and rhythms of the detected multiple wildcard expressions is 
given to substitution expression verification part 205, one for storing [a part] within a wildcard 
expression is added to the buffer for storing a part of a wildcard expression, wildcard expressions 
which appear continuously are handled as 1 wildcard expression) to the respective wildcard 
expressions detected in the vase of the second embodiment. 

[0152] 

In addition, the retrieval conditions set sin the first and the second embodiments are not 
unique to the respective embodiments. For example, the speech input time may be utilized at the 
time of the retrieval of a substitution expression in the second embodiment. In addition, although 
the first embodiment is described as if it was based on the assumption that an input containing a 
correct expression as a part of a wildcard expression, for example, " 4 su'-something," would 
never be input, it can be handled easily by setting a vocabulary item, such as "su/something," at 
vocabulary storage part 102. In addition, rhythms of all expressions can be used as retrieval 
conditions instead of defining a wildcard expression as a multiword substitution word or as a 
rhythmic word. 



[0153] 

In addition, the present invention can be applied not only to the Japanese language but 
also to all languages which contain wildcard expressions using a common unit for analysis, such 
as a syllable or a phoneme, during the analysis by the unit of a Mauler code. In addition, the 
present invention can be used also to retrieve [musical notes] of a song sung using rhythms for 
the parts where the musical notes are unknown, for example. 

[0154] 

The present invention is not restricted to the aforementioned embodiments, and it can be 
implemented in a variety of ways without exceeding its technical scope. 

[0155] 

Effect of the invention 

In the present invention, because a part where a part of a normal vocabulary item is 
replaced is detected from an input speech, and it is substituted with a normal expression 
appropriate for said part, even when a user does not remember acceptable vocabulary items 
clearly, an speech input containing said replacement expression can be accepted and interpreted. 

Brief description of the figures 

Figure 1 is a diagram showing an example of the configuration of the speech input 
interpreter pertaining to a first embodiment of the present invention. 

Figure 2 is a diagram showing an example of the information stored in the vocabulary 
storage part. 

Figure 3 is a diagram showing an example of the vocabulary items stored in the 
vocabulary storage part. 

Figure 4 is a diagram showing an example of the information given from the speech 
analysis part to the substitution expression verification part. 

Figure 5 is a diagram showing an example of the information stored in the metrical 
information storage part. 

Figure 6 is a flowchart showing an example of the operations carried out by the 
substitution expression verification part. 

Figure 7 is a diagram showing an example of the vocabulary items registered to the 
vocabulary storage part. 

Figure 8 is a diagram showing an example of the information registered to the metrical 
information storage part. 



Figure 9 a diagram showing an example of the information output from the speech 
analysis part to the substitution expression verification part. 

Figure 10 is a diagram showing an example of the result of the retrieval of vocabulary 
items which match the speech recognition result. 

Figure 1 1 is a diagram showing an example of the configuration of the speech input 
interpreter pertaining to a second embodiment of the present embodiment. 

Figure 12 is a diagram showing an example of the information stored in the vocabulary 
storage part. 

Figure 1 3 is a diagram showing an example of the information given from the wildcard 
expression detection part to the substitution expression verification part. 

Figure 14 is a flowchart showing an example of the operations carried out by the 
substitution expression verification part. 

Figure 1 5 is a flowchart showing an example of the processing procedure applied to a 
non-wildcard expression part. 

Figure 16 is a diagram for explaining the retrieval of a part of a wildcard expression. 

Figure 17 is a flowchart showing an example of the processing procedure applied to a 
wildcard expression part. 

Figure 1 8 is a diagram showing an example of the vocabulary item registered in the 
vocabulary storage part. 

Figure 19 is a diagram showing an example of the information registered in the 
substitution expression verification part. 

Figure 20 is a diagram showing an example of the information given from the wildcard 
expression detection part to the substitution expression verification part. 

Figure 21 is a diagram showing an example of the information stored in the substitution 
expression verification part. 

Figure 22 is a diagram showing an example of the hardware configuration. 

Explanation of reference numbers 

1,2. speech input interpreter 

1 00. speech input device 

101. speech analysis part 

1 02 . vocabulary storage part 

1 03 . substitution expression verification part 

104. metrical information storage part 

201 . speech analysis part 

202. vocabulary storage part 
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203. wildcard expression detection part 

204. wildcard expression storage part 

205. substitution expression verification part 

206. substitution expression storage part 

21. CPU 

22. RAM 

23. bus 

24. disk drive device 

25. memory device 

26. input/output device 
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Figure 1 

Key: 1 Speech input interpreter 

100 Speech input device 

1 0 1 Speech analysis part 

1 02 Vocabulary storage part 

1 03 Substitution expression verification part 

1 04 Metrical information storage part 
200 Specific processing 



Information 


Example 


Representation 


Tokyo/honyalal a/Hotel 


Presence/absence of wildcard expression 


Yes 


Expression type 


(OK/replace/OK) 


Wildcard expression type 


Rhythmic word 


Speech recognition parameter 





Figure 2 
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1 okyo/Stayin/Hotel 


Something/Staym/Hotel 


1 oKyo/sometning/rlotel 


Tokyo/Stayin/something 


Something/Hotel 


Tokyo/something 


Honyalala/Stayin/Hotel 


Tokyo/honyalalala/Hotel 


Tokyo/S tayin/honyal a 


Honyalalalalalalala/Hotel 


Tokyo/honyalalalalalala 




Figure 3 


Information 


Example 


Recognition result 


"Tokyo/honyalalala/Hotel" 


Word utterance time 


(650 msec/820 msec/510 msec) 


Metrical parameter 




Presence/absence of wildcard expression 


Yes 


Expression type 


(OK/replace/OK) 


Wildcard expression type 


Rhythmic word 


Figure 4 


Information 


Example 


Representation 


"Tokyo/Stayin/Hotel" 


Standard time 


(700 msec/900 msec/550 msec) 


Rhythm 





Figure 5 
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Figure 6 

Key: S 1 0 1 Is a wildcard expression present? 

5 1 02 Retrieve vocabulary items which match the speech recognition result from 
metrical information storage part 1 04. 

51 03 Is the wildcard expression a rhythmic word? 

5 1 04 Compare its utterance time. 

5 1 05 Compare its metrical information. 



Palace/Hotel 


Tokyo/Stayin/Hotel 


Tokyo/Marunoguchi/Hotel 


Tokyo/Inter/ Continental/Hotel 


Honyala/Hotel 


Palace/honyala 


Honyalala/Stayin/Hotel 


Tokyo/honyalalal a/Hotel 


Tokyo/Stayin/honyala 


Honyalala/Marunoguchi/Hotel 


Tokyo/Marunoguchi/honyala 


Honyalalalalalalala/Hotel 


Tokyo/honyalalalalalala 


Honyalala/Inter/Continental/ZHotel 


Tokyo/honyalala/Continental/Hotel 


Tokyo/Inter/honyalalalalala/Hotel 


Tokyo/Inter/Continental/honyal a 


Honyalalalalalala/Continental/Hotel 


Tokyo/honyalalalalalalalalala/Hotel 


Tokyo/Inter/honyalalalalalalalala 


Honyalalalalalalalalalalalalala^otel 


Tokyo/honyalalalalalalalalalalalala 



Figure 7 
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Vocabulary item 


Palace Hotel 


Tokyo Stayin Hotel 


Representation 


Palace/Hotel 


Tokyo/Stayin/Hotel 


Standard time 


(450 msec/ 550 msec) 


(700 msec/ 900 msec /550 msec) 


Metrical information 






Vocabulary item 


Tokyo Marunoguchi Hotel 


Tokyo Inter Continental Hotel 


Representation 


Tokyo/Marunoguchi/Hotel 


Tokyo/Inter/Continental/Hotel 


Standard time 






Metrical information 







Figure 8 



Recognition result 
Word utterance time 
Metrical parameter 

Presence/absence of wildcard expression 
Expression type 
Wildcard expression type 



Tokyo/honyalalal a/Hotel 

(650 msec/ 820 msec 15 10 msec) 



Yes 

(OK/replace/OK) 
Rhythmic word 



Figure 9 
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Key: 1 



2 
3 
4 
5 



Tokyo Stayin Hotel 

Tokyo Marunoguchi Hotel 

Tokyo Inter Continental Hotel 

Ratio 

Tokyo 

Hotel 

Expansion factor 
After expansion 
Standard time 
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Key: 2 speech input interpreter 

100 speech input device 

200 application-specific processing 

201 speech analysis part 

202 vocabulary storage part 

203 wildcard expression detection part 

204 wildcard expression storage part 

205 substitution expression verification part 

206 substitution expression storage part 



Information 


Example 


Representation character string 


Tokyo Stayin Hotel 


Mauler code string 


To-o-kyo-o-su-te-e-i-n-ho-te-ru* 


Mauler code length 


12 


Metrical parameter 




Necessary parameter for speech recognition 





Figure 12 



* [Editor's note: This spelling corresponds to the Japanese pronunciation of Tokyo Stayin Hotel.] 



Information 


FxamiYle 


Presence/absence of wildcard exnre<?*?ion 


Yes 


Original signal 


"Tokyo" "honvalala" "Hotel" 


Position of wildcard expression 


2 


Wildcard expression type 


Rhythmic word 


Mauler code string length of wildcard expression 


4 


Metrical information on wildcard expression 





Figure 13 
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Key: S201 Is a wildcard expression present? 

5202 speech recognition processing 

5203 Output recognition result. 

5204 Apply speech recognition to the part other than the wildcard expression. 

5205 Detect a partial normal utterance within the wildcard expression. 

5206 Retrieve an expression corresponding to the wildcard expression part. 
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Key: S205- 1 recognition by the unit of a syllable 

S205-2 Is a partial recognition result of the target part present? 

S205-3 Store all target parts. 

S205-4 Input speech is longer than the partial recognition result. 

S205-5 Nothing is recorded. 

S205-6 Decide the position of the partial recognition result. 

S205-7 Occurrence other than the partial recognition result is found. 

S205-8 The occurrence found is adjoining wildcard expression. 

S205-9 Store the occurrence found. 
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Figure 16 

Key: 1 Mauler code string representing separated [parts of] the original signal 

2 Mauler code string representing recognition result ('Tokyo") of S204 

3 Input: 'Tokyo su-something-Hotel", Wildcard expression "something" 

4 to-o-kyo-o-su 

5 to-o-kyo-o 

6 number of Mauler codes matched 

7 When (a) and (b) are compared, partial recognition result "Tokyo" is considered 
to be under condition (a). ^=> Remaining part is "su." 

Also, this "su" is placed immediately before "something." =3> "su" is the first 
character of the wildcard expression. 
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Key: S206- 1 Retrieve appropriate vocabulary items from vocabulary storage part 202. 

S206-2 Restrict them using the information obtained in S205. 

S206-3 Is the wildcard expression a rhythmic word? 

S206-4 Further restrict them based on the utterance length. 

S206-5 Compare its metrical information. 
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* [Editor's note: This spelling corresponds to the Japanese pronunciation of "Tokyo Intercontinental Hotel."] 
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OFFICIAL NOTICE OF REJECTION 
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Examiner, The Patent Office: T. Kashlmoto(9379 5C00) 
Date of Draft: December 25, 2002 
Mailing Date: January 1 . 2003 

Applicant: secretary of agency of industrial science and technology 
Applied Provisions ) ; Section 29 Paragraph 2 

The present application is rejected for the following 
reasons. The applicant may present an argument, if 
any, within 60 days from the mailing date of this 
Official Notice. 

REASONS 

The invention(s) of the present application as 
claimed in claim(s) set forth below would have been obvious to 
one skilled la the art, to which the invention s) pertam(s), 
prior to the filing date of the present application, on the 
basis of the publication s) set forth below as distributed in 
Japan or foreign countries prior to the filing date of tne 
present application. Thus, the present invention s) 
is (are) unpatentable under the provision of Section 29, 
Paragraph 2 of the Patent Law. 

Remarks (refer to a reference list below) 

1 i-.HHpq i m 1 4 *nrl Rafftrftncfls 1 and 2 

Reference 1 discloses that a specific keyword phonated 
before or after a character spring is regarded as an arbitrary- 
character string, and then, the keyword portion is complemented 
Reference 1 also discloses outputtlng a list of complement 
candidates if there are a plurality of complement candidates. 
Further, reference 2 discloses that a portion subsequent toa 
fragment of a word is complemented when triggered by a user s 
intentional "vocal pausing after phonating a fragment of a 
word" . 
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(in particular, refer to claim 7 and paragraphs [0093] to 
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TV>4. 04-CttJB3*lT^4*Blie* r ^J U**>S 

itwnia^swwfcaBiLTfio, ±;*Kft4*Ep* { tti 

T#Cft4*P*M^ffiv^R#£?l 
LTV>4„ ry^;n.^_H^^ftEj A* 

s^utw^ftca^yt^'f ^ na- v^m^ttix 
t »*. ^ffifsf4*fjfc-r4i§®cci»-f 4020 

(402K:fc{t4 raStffflBBj AMkHt-CftS. H4 
US"?. r *--v 777j * { 7-f ;P H«R"e»* 
r7^;UH*-H«Hw«Hj flW»4, A^ttJ 
*»*«aW&fc«)WflH8-Cft*. £<0*§£(4 r*:i+9 

[0046] 1 0 314. ffi»#*rffl 1 0 

\^xmmrz>. 

[0047] w&msixm i o 4 {4. wwmwas® 
i o 3 csnseu rasEaff 1 o 2ta»s<iTv^s 

[ o o 4 8 ] 0 5 immmmm 1 o 4 ti eii§ *it 

v^flHR^HRTft*. hb*tX rj(ojtxf— Y 
<0**flWR?ft 4 . raflU*H j ffi$Bf412fl£ftT V*4 

mf**m&i£R ix a < . £*>flwito«£fri»4ia4 

<9 r#Bt?flffl|j fl!»0*;h.fcHtT'ft4. r«fltj 

fflf8<4l^li$i^Tv^|,milwy7 ^ ;^*^)»?f^^ll»fl 
SflHRSraUO^. fflU «S«ffi$£«*r^4:£r£l4 



4SWIffi$i . ftf*j}-flfS 1 0 1 0>&Kft3mag&3 1 

[0049] meit^mmmmxmm^m^ **iw» 

[00 50] Uf-y7S101 W#*f 

«i o i ^WTOawsmt^-f ;p f#- F*3W<ft 4*» 

i:'3#>£51Igt4. iW4. «9»^HV1 0 1*»4>*3 

■S-te^f-'yTS 10 2^. 7>f /PH^-H^aWSPttL 
[005 1 ] (Xt-vTS102) ZnXT-yTXU. 

MtSBl 0 4KfEli£*lTV>4ti!f8 (05 ) 

- vmrnfttiptim i o i *>t»sfi*flMii (a 
4) <o9&*mmm**mizbizi')t&>. *o 

[0052] «£tr % ff<>n^tf msattift^ r m^/ 

m$i)X°h~>tzt-rht. rjK/xf-^ fy/*f 

ifwiat, mis r «^j jWftajfcfcfcu *s 

[00 5 3] Uf7rsl03)Cmfy5Tli, 
»S*>'JXAS*»*JpJ»W6. ^^{4. %p#mi 0 
HTHISaWCft 4 . * . 'J XAlgO^{4^7 : - 

77S 10 4^. ^#l§a^iS«o^{4xr 7 rs i o 
2TttW3*utii**ayju «yit»7t*. «. aj 

^-5/3^(0)11 (H4'20 0) T*JgS*i*. 
[00 54] Ur-yTS 1 04 ) imf^Tt'li, 

^fvrs i o 2-c«ajsnfcsafc-3^T. 

a i o i &t>mtvk. rmmpmmi mtmmmm 

IBItai 0 4{CfB«*#lT^4 Wj tfffit^it 



(8) 



igBPPl 1-95793 



k, mmmzmtmrnmimmi 0 4mmm 

ftjfcHffifciftJg* * Z k fc*TffiT** . 

[00 5 5] (Xf'/TSl 0 5) itf)*"? •fTtNi, 
Xx-yTSl 0 4-rttaj§ix^iS^tco^T. 
SI 0 1*6*3 *ut r«at"C5^-^ j ffittkff&ffi 
«Kttffll0 4fc:£S§*vc^4 r^y^^-^j-tf 
«k£ttlW-6£fcfc:J:oT» E:fr*SS*£fc5&*- 

x^7f^ v/j ( a*t*^^«sacdfe. «8^ 

9/!, pp. 29-30) tBB*S<ifc^rffitJ:'J, D 
P&^iJffl Lfcv >y f-y^ffd c: k t i ->x ifcllHr 

->X%>WM\ 1fWcSix*^9^- 

fflLTfclfcbfrv*. -eft, fB»Ufc**fc*fc««f 

[0056] JSLfctf. *ftlll&ffi*»**38!B£« 1 0 

3<raHUSfc*oll«, tiiWWM. 

[ 0 0 5 7 ] Rwc, ±3iL/i#^A^lj»K*ato^ 

k LTfflUPBS'XxAfc LTfflffl^^A^fcflo 

[0058] £<9ffi0ffi$8^X^A«;Uo<7)*7VU9 

SilTfcO, -?-W4Oi0*r^«»* s MS1iai 0 
2£fEI*£ftTOl>k-fl>. ±tz. mmi i miQ2{ l z 

[ 0 0 5 9 ] * fc , flftffllietttt 1 0 4 WiSiiSiX 

fc4o<G*?;w«^«*tiwiL iRmim. mm 

mmzm&ztizx^x. m8iz*?£o%ft®tf 
im^tix^tt-ti. 

[0060] zlx. mmtf r m^T—f >*t 



Vti-vmm. ^-^777] U r*r-4 yj coyx 

^saaiLfciimk't*. 

[ o o 6 i ] jar, *M«*tw<o«^fc*j»t*4M»««» 

[00621 41*, *«Hfr» 1 0 1 Tii, A*$ilfc 

l -e ii 7 tc $> « mmxmmmm zmm 
i. zix. mm&&kix rm£/*-A>777/* 

X, 09 (z^fllflifr »ft»£!H48IS 1 0 3 teffl*^ 
I). 

[0063] z<?m&*%vtzw.wimm^ 1 o 3ti 

[00 64] (Xf-y7°S 1 0 1 ) mZtVfcVJ iVV* 

mtffo&tpmtx. xf yrs 1 0 2tattf. 

[006 5] (Xr-yTS102)B«&»ffl«rj|cft 
/*-+7 75/#T7l/j k, ^^SSffifB 

a i,^$-iB*fflfgfE«gB i o 4 bfiftShfcHfe (0 

immm^mz^xitthkth. *ix. r m^ 

[0066] (Xr-y7°S103) SESfuty^^H* 

7771 teVX&mX'fohtLX. Xf77S104t 

[00 67] (X-r-y7°S 1 04 ) Xf'vTS\02X' 

4>SWratS# (08 ) fc, ff^iHffSl 0 ls6>4,*S 
ix?t#i5^^BfgWP8k^Jt!K-rs. Witf. 4-f. ^ 

r](pfcj : 700/650 = 1. 0769, 
r*f/kj : 5 5 0/51 0 = 1. 0784fc2r*. <^ 

m ( 1 • 0 7 7 7) £ A*B$li!£ffiStti!ffif5«a! 1 0 4 

{zhmm^mxy-i^tirhwm^b^h. z 

20msecXl. 0 7 7 7 =8 84ms e c ktSih* 

act. r mscj k r *-f^j ^rat$>o, v^^f^- 

IMIi900msect^. -?-LT, Ztl^2r> 
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01 owf^rs i o 2-caffi3*ifc 

[0068] rjpfcxy^-ayf-*^^;!^ 

Wm$m (700msec/650msec/1050 
msec/550msec) Oft, rxy?— j l"3y 
■f^y^/l/j fc«3"f * 650+1050 = 1700m 

*Wfig£l OOmsecttSL ±K«« i 0 r K# 
[0069] (Xf'yrsi 05) i*i4T«®lK:J: 
5. * WJ*4Mfr*l 0 lfrfciKSfifc 

GnW® (0+200) -caHJWrJHIifTd . 7 

[00 70] JjUiT r I^*-A-7 7 7*f;h 
[0071] JJUiOttlHfcJ: oT. 43UtiBflUcffi6# 

t^o zmwrnztm ix v v* v*r»"c«> , 

77*r/H trior. 
TV** 

[0072] (820HJ&BJB) KC, *«ffl«)*2^> 



[ 0 0 7 3 ] * 1 ^HE»KBTIi*W8W5r3!Ci: » 

mmimzm^z to-ca^a*. 
x-bh. 

[ o o 7 4 ] n i i ^mmm^h^px^mm. 

1£SB2 0 2, *7^f;PHXr-H«K«iaMW2 0 3, 7^^ 
Frt - KSaiBtttf 2 0 4, S^^^^gP 205.fi 

•r^m^hT : J^)vm^z^mth a/dssjus 

[0075] *j»a*r» 2 o ui, am^aaa^ff 2 o 
5 fc . eikiettfls 2 o 2 h , jBA^nettii 2 o 6 

b . HieEttS 2 0 2 *>B8I«SI SltSC 2 0 6 <0 i'*> 

-e^uss* raif^^ffi 205 te{B*-r * . 4 , n 
rnm<7)mmzjfctxmmmmz'tf\\ mm^^t* 
-^lE^ij b Lxmmmmar® 205 (cta^s . & 

[0076] IS^IE1ig|52 0 2«, ff^*flf»2 0 1 
b , 1^131^2 0 5 fc tC««L, #J»fBI«»«<0 

(jEaw) »««rfi«w-*»»tr*o, mama?) 
mmz^xm 1 2 t:srrflM8* i &^ff«2 0 1 , 

a^«^^a52 0 5 mm ■ mmm&BftX'tmt 

[OO77301 2\mmnm 202 mmt&m 

fc«i6LTBiaE««2 0 2*«E»t*flHB*0!lk IX 

m^-m^ommix^i. trnv^*-*! 

#9£. pp. 29-30) fcrB*S*ifc**SriftJ: 

f£*ffi(i^ 1 . r 

»to«SM:-'<5^-^ j flMWi. *»J!*!IJW*IBfc 

#]»»«hw 2 0 1 x'$tmt& : gptm<7)KMzmiz& 
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7 * - 9 t-ov >T OBM£tMII*&«rt- § ) . 
[0078] 7>f;UH^-H«SEflBR204tt, 74 
^K*-K«HI*aj»2 0 3fc««U Wilf r ^fc 

(CKftSfLi^S-CfcSV-f^H^-H^S*. 74^ 
KXr— F33g&ai&2 0 3*>'#H3 . mmmKJ&ftXtl 

^ %m<D v u xai§ t t^irt ias -t & . 

[00 7 9] 7>f^K*-H«B«aj«2 0 3tt, V>f 
?&fc'?)#^A:JlgK 1 0 0 b . 74 Ktf- F£«iE 
1iSP2 0 4 . gf^IM!^S52 0 5lC««U 74/W 
F#- F3HSlEtt»2 0 4 fcEttSftT Hi 74 ^ F# 

SSVol. J-74-D-II 1991^2£ P 
P. 1 2 1- 1 2 9) £BK?3*i-0>4:friS J 3ri:£JBlr> 
XtfUUtl. ft. ^OS*t»aj-CS 4#ffiT*>ii 
If. Jb£<0;&5Slcl8&'*\ ffi^ttffl^-CfcJftb&H. 
^LT. 74/PF#-Fgig1$ttJSB2 0 312. H13{= 
*Lfc J: 5&ffl«£fflft£3!!g[£S2 0 5fc-££, j&a 

[0 08 0] 01 3tt>7-f^H*-Ha3K«aja52 0 3 
*»fe«»^S!H^«2 0 5 . 4 

fcflte^WiSVt. ry^F#-Ff»W*j ti7 
■f^H*-HS8SA«y>f*H*-H^!gttaja2 0 3T' 

7 7 J #74 F*?- F*3K(c &fc 9 . r fl- 0 j 2r 

4/i^f#— mm<mttX'W o at L-cBaaaiBttes 2 

0 5fc»t. WCIiTJj >>>7*3 7#-+55*t 
#74;UF;$-FSigi r *-^77j T'tMKSJi 
r F7* 3 7j r^^jt3-5^g| 
SftXJtlcHliSSSte* 2 0 5 tzmztLl . r -7>f ;u 
F#- H^SOtftllj 1274 ;U F#— FfSBAqjqt*-* 

mMZixtzmm^nn^nm^tfvj ivy 

T(2 3 -3{C^(tS iifcjf fl^<7) 2 r*- t 77j 
36 t *6WC2*«aj*S*l"CH4. ""y^F^-F^S 

cosiij ii^$ix£74^F#-Fsw. mmw 

K»8Ett»2 0 4ta»S<iTv^fl|«fc:J:-5-rH* 

S. r 74/PF#-Fi£S<9*-7f2-5|?iJJIj 

7 4 ;u f ii - mm { u xai=-c'& <o 



4^F#-F«9§i?ilfi?#j ttttffiS<lfc7-f^FXr 

ft. mm>*7*-?*&$L-?&-Hiti<z^x\s.. 

EMBtt»2 0 2. 9S@gg|E 
tt*2 0 6Jci^;&;K*^fcRtfc«£*Si<OT£ 

[0081 ] K8t$%Sg&S 2 0 5 li, 74 ;l/ Yii— Y 

mmm& 2 0 3 h , w?»7Wfa 201k. usiatai 

2 0 2t. »^^ieiigP2 0 6tf^L. 7>f^H* 

[0082] wmimimn2 0 6 fn*7>*f»2 0 
1 1 . ms&8Wtem2o 5c«RU i§«ieiia52 0 

2lca«SiiTV^Sfs6>^. Mitf r|^xf-' f > 
*f-;U-j *»4> r 3f0£j r xf— 4>j r^f-^j coj;^ 

*41fl*aseflfflS2 0 2 4:Ht?^: (H12#BB) 

[0083] ni4 \±immmx*mwj:mz 
mmm-&®2 0 s^im&z^wjst** . ot. 11 

1 4 *#!BLTJ!H«)aBt*»IH-r4 . 
[0 084] Uf7/S2 0 1 ) A*S*L/lff?»7Jj 
1 7 4 ^ H * - S j&» if 5 jWKW S . ZtM 

7>f^H^--H«Btliaia52 0 3*»^i6*li r 74 
^F^-F^iOfl-fcj If $fi (013) a»£5BrcS 

S2 04^. VAiVYfi-Ymmtft&LWIrttifXT- 
■yrS2 0 2^»tt. 

[0085] (Xr-y7"S202) V^Ftf-h'SS 

3 . x^titzM.m^znLx^ j ifmu2 0 1 tigs 
iaig§U2 0 2C£ttSim>4Birr«oJjiSi8»£flaH 

[0086] (Xr-y7 , S203)^?r7>*f»20l36» 
a (0+2 0 0 ) . *4v^iJ: Oa^W^ffJOS^ 
[0087] (Xr-y7*S2 04) 7>f^F^-K^3S 

if. 7>fyPF^-Haamaj»2 0 3*»<5>«ioiis<i'r 

7>f;UF^-F^^fi^-S:^46. 7-f;Uh'^-F 
SST'li^l^ (#74;PF^-F^^) <73fi^tc 
MLX. WJ»7>fffflJ 2 0 1 £Hft$3E1SaK 2 0 6 icfE 
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ffitoWlt L*v^«^li, **>#7-f ;p F#- F*%8 
[0 0 88] (Xf77S20 5) iiTtt, tP74>V 

ya- vmmt 74 ivy*- Fast omzmkii*) 

Izf&iZti&b* 74;UF*-Fa3SEttS2 0 4fcS 

x'bh<nx\ mm^tfvjivYt-vmmimb lx 

mZtiXLto. dfl5i3**^(ctjv^Tt. #74/1- 
F#-F^K»W*{C. y^/WH^-HjESO-SkS 

74^F;&-F*Rtf>-*i: ±-3tef 4 

CO 0 8 9] «Wi§*i;fc7-f/UF;&-FS8Raw> 

6. £W<?77Ji#7-f/l'F;&-F*«Si:7-f;i'F 

**-7WCE»r& tfttusfifc 

^UcttJELTA-y 7 rfi#y-f IVYX- FH 
*KB S *lfc#7 4 rt' F - F 3&m<?) oh.VJ/VY* 

-mmmzfmLx^z>&ttcr>zti?tit l zitiix . a 
1 5«^ttj§ix/i^y-f^F^-F^giico-^^-r 

S«3 U-r-yTS 2 0 569*0:3) cOflpgf|ji!c£^LT 

ITFT'te. 01 5^^m.Ltkifti>WR^o . 
[0 0 90] Uf -yrS2 0 5-l ) ZtoZf-yT? 

<0*»kv^ii:SrW^4. tt*fc$r->;fc#7-f 
^Frt-FSSMtetfl/C, *«ttr*2 0 1 (CtftMl 

[009 1 ] (Xf -/rS205-2) Z\<7)Xtv?X 
12, JKtlS^kfcoT^4^>OUF;&-Ff«fc»JE 

^BWSftj&WL^Vte^JdLXf-vrs 2 0 5 

2 0 5-4^**. 



[0 0 9 2] (Xf-y7*S2 0 5-3)«fcH*fc:firo 

x^hf&4)VYii- Ymmiznm-h®ftwmi%. 
shew* 2 o 6cofs^«t o bjevissi* i/a^w 
w* i/o * * 7 4 ^ f a- FasiaoHrc* « 1 1 , 

£<3#74 /l> Yi)- Ff3I#<R& LX^hVjiV Y*l- 

Ywm<r>mmzbi>i)\ ^mzhht^mi, 

t-5E# («) 'y77£EttU 
F*- F*B*# 'J XAHT*&«^li. 7 -f /I/ F*- 
FftSSWMW 2 0 3 rt> Wt -> r 7 4 - k& 
ig^^jjlj fl^gtA? 7 rfcEttLfct-TJifa 

-Ymm^cDmmz^^Lth^it. rvjiuYt-Y 
m.<r>m. j 1 . mr-ti . 

[0 0 9 3] (^f7/S205-4) ii^li, *f» 

t^->T^i,^7-f ^ f#- F*saw)4»fc, nm-h 

Witf. SffiWRk^roTV^^^-f/l'F* 
- F^fcW^SS^HMBBWta^t-^Ef'^ 

M^ft^tV^TW^r-yTS 2 0 5-5 

«^liX7 i «yrS20 5-6fc«tf. 
[00 94] (^r-y7*S2 0 5-5) mm&bto 
X^mv -ifvYi]— F*ffi(C(itt£?*aMtiBtttt« 
JSLhwflHitt* v ^ t ?JBi L . ^" >y 7 r t JiM fc A^-fr-f 

[0095] (Xf77S205-6) SffiH«fc LT 

F#- FfEH{cJi««-r4SiJ«-BiWS»<offit:7'f ;P F 
^- FS3itf>-Sa*»J»Sivo** ^Tttttj^** kfM 

«»^hsawa**9p7>f )VYii- YWimmM^rn 

[0096] mili. 01 60i a (CttjMSttlftJIkTC 

T»4«>. W4M)t-7Ef'M*itlW4ii:{cJ:')««> 
*. HI 6T'{Sg|5^i2i^M rjRjjtj <t-5E^I 

i:S:Jt«L-rv^A^ g|5^I2^*^-7E^iJft(i 
4 T. IWHHBBIWSiR^t-^E^Wi 5 1 %->X 
H*). ^BMSaMiSTIifttBlftW-ftE^i r F^ 

^ ^ r k rjj-j (m)<?)*) ft h 2r><D 

[ 0 0 9 7 ] K<r> s ^x\m<r»^-vifimL^ 
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*i-^4*-?KTO*>^**Bf*»fl- 
BHW:Ba*#fc*4*l»rfc LTSiRU ^IM^cO 

[00 98] HI 6*>WT«:ftfiM>:S?? r^j #£9?) 
[0 0 9 9] *fc, HW-4*-?K*fta«*fc:$:4 

Lfcnfc«»r*4. *4Wi. -»t6t-9IE-MW t 

S>4 L * v MWJIT-C* -5 fc*£i& "5 Og&#i4#£ 

[0 100] (Xf-y7°S2 0 5-7) ZZX'U. Xt 
•y 7° S 2 0 5 - 6 O&gL & 0 OTSMWaffi-C* fc jfcif 

S 2 0 5 - 8^V * 0 £>S#a«fiq£ WUfxf- 7 7° 
S2 0 5-5^Mts. 

[0 101] (Xt77°S2 0 5-8) ZZX'te. Xt 
•yrS2 0 5-6<^M*, J*tHS*lfcsfc9<09HW7-f 
/l^Ftf— K«3ltt#tcR$ LfcbZb £ 0 

a»*WK*4. HI 6*>0fCtt7-OH«$-K*S r-r 

WBfSit*. at. rt^F^j # rF7* 3 7Xj to 
Wfc:#£l/0*4*&tt, r 3 7X j coffi&mz 
r Xj 14 r T ybX? j fcliRftUOvflr^fcW 
Br£*i4. £*>*&{4. r M r F7j &k'T"£> 

*uf v a tv yx- Y$m r -t y h a j ^itatsss o 

4 t «rTS 4 . MKffi^t^ 0 jWSRSEtfitf . ^ 
r 7 TS205-9 ^Mti . 0 jWWE 

WUf, Xf 77°S2 0 5-5^ittf, 
[0102] (X-fy7°S205-9) iiTJi, Xt 
y7°S 2 0 5-6t«iaiS*lfc*0^*4h& t 7-f^H* 

L"0 -> 4 7 ^ F # - K*Eaw>-»T* 4 1 
U £^£9<^#;«&LT^474/1/F#-Ffl^ 
a&0Wfflfc:*4A\ ««fc:*4*>*¥lI«L. 

K*S«** 'J Xi> tST'fc 4 *§£J4 . 7 >f )V Y ij - Y mm 
«Uti*2 0 3*>4>£»ti:-9fc ry-f^K^-HRH^X 
^iJft j flHUfcy < -y 7 r £Ett Lfct- ?E<HMttflt 

[0103] m<r)-m<rm^ , **#w*2 o i t 

7>f;Uh*^-K«8aft{B»2 0 3fc*4J:3**H*ai 

7s 2 0 4xnbntz%pmm$knm$m&zft 



^*mt 0 . *«Mfr«2 0 1 C*0«ttafBBBNI 
fcflaHt4ifcfcJ:o-C. ±EkRt<7'f;UH*-K 

«rcfc4. 

[0104] (Xf77S206)Xf 7/S204- 
S2 0 5T'OM=±^Tf#<^l£fif$fc, 74/H0& 
-F38Blftaj*2O3a»4>fc4>*i401 3t*LfcflBB 

mm^frt lx. mmm&2 o 2 tgEttSfi-o^ 
s»e-iW4 i 0 1 . jmfsssfia! 2 0 6 jcieibs 

itt n4B*0»67>f ^ H*- HSgBaMJ-fcftTJii 4 
MttlWrt-4. Bl 7(iXr 7 7-3 2 0 6T'fi : '5il^ 

[0 10 5] (XT7TS2 0 6-1 ) Z<F>Xt«/7X' 

«»2 0 2££»SivO*4flT« (012) «0«*tS|g 
Sr^OTL. ^7>f/PK*-H^safi-oaf»BiBSilw 

^.im^mzm^-rm^. y-4>uYtj-vmii& 

^ilg|5^$r^fti:-r4Ci:{cJ:0. 8BW-4. *LT. 
IBWa!E*lll52 0 6tie»S*iT^4«S*>4>, 1^ 
SiifcB*^)7-f^H^-H«HTf«H»SS*ifc««' 

y4)\sYt-Y$m<r>mm®.frt> rjtar (^^/p 

*<0Htil«Sr<i:<>l#SeUiffaEl-4(> 
OSril^-r4l5gtLTiM^1-4„ ^LT. KS^SIS 
ligp 2 0 6 *» 7 >f F * - § tvtittft b L X . 

[0 10 6] (Xr-y 7°S20 6-2) ;mf77T 
(4Xr »7S 2 O STH&SSfifcA*? 7r fclE»<?#ife 
^-512^ («> *«lS(8ftfrfcLT, XT7 7-S2 06 

[0 10 7] (Xf77S20 6-3) d^Xr-yTT' 
{i. OT2^Ht-^*ix4 7>f ;u F#— F«S*^* 
lS»ilS^UXA|S^5rfiJ»iJ-r4„ dix{4. 7-f;PH* 
-F«Sftaj*2 03*»<9«S*l.4Hl3<0 i"7^/l/F 
^- H^SOWi j ffl?gT-«i!2*^agT-*) 4. -tLT, 
•JXAll£7)*i^J4Xr-y7 , S2 0 6-4^3t^, R«H 
imiSO^(4Xr 7 r S 2 0 6 - 2 TtttU 
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